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Preface to the English Edition 


The major part of this two-volume textbook, with the exception of some 
supplementary material, stems from the course in mathematical analysis 
given by the author for many years at the Moscow Physico-technical 
Institute. 

The first chapter is an introduction. It treats of fundamental notions of 
mathematical-analysis using. an intuitive concept of a limit. Ultimately, it 
even establishes, with the aid of visual interpretation and some considera- 
tions of a physical character, the relationship between the derivative and the 
integral and gives some elements of differentiation and integration tech- 
niques necessary to those readers who are simultaneously studying physics. 

The second chapter is devoted to the notion of a real number which is 
of this chapter given in small print may be omitted by the wader i in his first 
acquaintance with the subject-matter. 

Ati is my belief, which incidentally coincides with the traditional point of 
sented for. functions of one. independent variable and only after that extended 
to functions of several variables although this leads to some unavoidable 
recapitulations. On the other hand, in a comprehensive course intended for 
students in the fields of mathematics and physics it is quite possible to pass 
from functions of one variable not to the cases of two and three variables 
but directly to n variables. Here the whole question rests merely on a suitable 
choice of notation. However, such notation has already been elaborated in 
scientific journals and monographs and has proved expedient, and now it 
only remains for the authors of textbooks to accept it. Such an approach 
provides the necessary prerequisites for the second half of the course where 
in the study of such topics as the Fourier series and the Fourier integral the 
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reader should acquire a good understanding of the concept of an infinite- 
dimensional function space. 

The notions of an n-dimensional Euclidean space, of an arbitrary space 
with scalar product and of a Banach space are introduced in the course 
at a rather early stage. They are then widely used but onlv to an extent 
required for the realization of the plan of the book. 

The presentation of the subject-matter of the book is based mainly on the 
notion of the Riemann integral. To save the reader time and effort I have 
always tried, when possible, to give similar proofs of the anulogous theorems 
in the one-dimensional and many-dimensional cases. 

There arises the subtle question of the completeness of the spaces L and 
La. In this connection I do not introduce abstract elements which substitute 
for the Lebesgue integrable functions simply confining myself in the general 
discussion of the question to an explanation of the corresponding fact in 
terms of the Lebesgue integral. 

Incidentally, the textbook includes a supplementary section (Chapter 19, 
Vol. 2) devoted to the Lebesgue integral. I hope that many of the readers 
will be interested enough to look through it. The concept of the Lebesgue 
integral is essential for modern mathematical physics. Without using the 
Lebesgue integral it is quite impossible to study the direct variational 
methods of mathematical physics. 

Chapters 17 and 18 (Vol. 2) also contain supplementary material. Chapter 
18 deals with such important notions of modern calculus as the Sobolev 
regularization of functions and the partition of unity. 

Chapter 17 is devoted to differentiable manifolds and differential forms. 
It culminates in the proof of the Stokes theorem for the n-dimensional 
space. This chapter may serve as a test of the reader's grasp of the material 
of the book. 

My intention was to help the reader to proceed more easily to the study 
of mathematical physics. A number of supplementary topics included in the 
course have been chosen particularly in consideration of their use in mathe- 
matical physics. There still remain a number of pedagogical problems to be 
solved in teaching the theory of functions of several variables. It is hoped 
that this book will contribute to the purpose. 

I owe a great deal to two books that have helped me greatly. 

One is Course d'analyse infinitesimal by Ch. J. de la Valleé Poissin, a 
book which I studied assiduously in my student days. 

The other is An Introduction to the Theory of Functions of a Real Variable 
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also attended. I wish to express my deepest giatitude to these distinguished 
scientists and especially to A. N. Kolmogorov to whom I am greatly in- 
debted for scientific inspiration. 

In the prefaces to the first and second Russian editions of the book 1 
mentioned a number of persons and organizations from whom I received 
valuable advice in the preparation of the present course. These were the 
Chairs of Mathematics of the Moscow Physico-technical Institute and of 
the Moscow Institute of Electronic Engineering and also O. V. Besov, 
A.A. Vasharin, I.N. Vekua, E. A. Volkov, R. V. Gamkrelidze, A. A. 
Dezin, L. D. Kudryavtsev, P. I. Lizorkin and Yu. S. Nikolsky. 

To all of them I once again express my warmest gratitude. 

Finally, I wish to express my appreciation to the Mir Publishers English 
Department and to the translator of the book Professor V. M. Volosov for 
their most efficient handling of the publication of this English translation." 


S. M. Nikolsky 


* The present translation incorporates suggestions made by the author. — 77. 
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CHAPTER 1 


Introduction 


§ 1.1. Preliminary Remarks 


The name “Mathematical Analysis” is a modification of the old name 
“Infinitesimal Analysis”. The latter provides some more information but 
is itself an abbreviation. It would be more precise to call our course “The 
Analysis by Means of Infinitesimals”. 

It would be still better if the title of the book characterized the objects 
subjected to analysis (investigation). In classical mathematical analysis 
these objects are mainly functions, that is variable quantities dependent on 
other variable quantities. 

We say “mainly” since further development of mathematical analysis 
showed that its methods can be applied to the study of some more complex 
objects than functions (functionals, operators, etc.). But at the present 
stage we shall not speak of them. Our immediate task is the investigation 
of some sufficiently general functions, used in practice, with the aid of 
infinitesimal.methods or, which is the same, with the aid of limits. The 
essence of these methods will be gradually presented to the reader in the 
course of the study of the book. Now we only confine ourselves to saying 
that, in particular, these methods lead to the extremely imponan operations 
of differentiating and integrating functions. 

Sections 1.2 and 1.3 deal with the concepts of a set and of a function. 

‘The following three sections (1.4-1.6) are of a purely introductory char- 

“acter. They will give the reader a general idea of the fundamental notions 
of mathematical analysis which will be studied in detail later on: the con- 
tinuity, the derivative, the indefinite and definite integrals. 

In this chapter we of course use the notion of a limit but do not define 
it or explain it relying completely on the intuition of the reader. There 
can also be suggested an alternative way of studying the book: the reader 
can first omit Secs. 1.4-1.6 and then come back to them whenever they are 
referred to. 


§ 1.2. Set. Open and Closed Intervals 


In mathematics any collection or system of objects is called a set. For 
instance, we can speak of the set of all trees on a given glade, of a number 
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of geese feeding on it or of the set of all integers. If A denotes a given set 
of objects and x is one of these objects we say that x is an element of the set 
A (synonymously, x belongs to A) and write x € A. 

If y is not an element of A we write v € A or y ¢ A. 

If one and the same set is denoted by two different letters 4 and B we 
write 4 = B; it should be stressed, when necessary, that this is a set-theo- 
retic equality which must not be confused with an equality of numbers. 

If, for any x, the relation x € A always implies x € B the set A is said 
to be contained in B or is called a subset of B. In this case we write A c B. 
It should be taken into account that, according to this definition, the rela- 
tion A = B is a special case of the relation A c B. For if not only A c B 
but also B c A then A = B and vice versa. 

If a set consists of a single element x it is preferable to denote this set by 
another letter, say A, because, logically, we should distinguish between this 
single-element set and the element itself. It is also necessary to introduce 
the notion of the enipty (void) set containing no elements at all and to denote 
it by a special letter, for instance, O. By definition, O C A for any set A. 

As is known from elementary mathematics, it is possible to establish a 
one-to-one correspondence* between the real numbers and the points of a 
line by applying the following rule. With the number 0 there is associated 
an arbitrary point O, the origin. The length of a certain line segment is 
taken as unit measure. Then with every real number +a (a > 0) there is 
associated the point of the line lying at a distance of a from the origin to 
the right or to the left of O depending on whether there is the sign “+” 
or “—” in front of a. Conversely, if A is a point of the line lying at a distance 
of a from O we associate with it the number +a or —a depending on wheth- 
er A lies to the right or to the left of O. l 

The straight line for whose all points a one-to-one correspondence with 
all real numbers has been established, as described above, is called the number 
line or the number axis or the. real line (axis). Its points are called (i.e. are. 
identified with) the numbers which they represent. Thus, we can speak of 
points 0, 1, 1.2, V2 and the like. Bearing in mind what has been said we - 
shall interpret the numbers as points (of the number line) and, conversely, 
the points of the line as numbers. 

Let some numbers (points) a and b. satisfy the inequality a < b. 

The set of all numbers x satisfying the inequalities a = x æ b is referred 
to as a closed interval (with end points a and b) and is denoted as [a, b]. 

The set of the numbers x satisfying the inequalities a « x < b is spoken 
of as an open interval (with end points a and b) and denoted (a, b). 

The set of the numbers x satisfying the inequalities a = x < b ora < x = 
= b is denoted respectively as [a, b) or (a, b] and called a half-open (semi- 
open) or half-closed interval (also, simply, a half-interval). The half-interval 
[a, b) contains its left end point and does not contain its right end point 


* [n this connection see also § 2.7. 
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while, on the contrary, the interval (a, b] contains the right end point and 
does not contain the left end point. 

We also often consider sets referred to as infinite intervals (also half- 
intervals) of the following types: (1) ( — œ, œ), (ii) ( — «9, a], (iii) (— æ, a), 
(iv) (a, œ) and (v) [a, æ). 

The first of them is the set of all real numbers (of all points of the real 
line) while the others are respectively the sets containing the numbers x 
satisfying the inequalities (ii) x = a, (iii) x < a, (iv) a < x and (v) a = x. 

Let A and B be two sets of arbitrary nature. By the sum or union of A 
and B is meant the set, denoted A+B or AUB, which is the collection of 
all the elements of A and of B. 

The difference A\B, also denoted 4 — B, between two sets A and B (in 
that order) is the set consisting of all the elements of A not belonging to B. 

The intersection (or product or meet) of A and B is the set, denoted by 
AB or Afi B, containing al the elements which simultaneously belong to 
Aand B. 

There holds the set-theoretic equality 


(4+B)C = AC BC (1) 


where A, B and C are arbitrary sets. For example, in the case of the sign “+” 
we can prove it as follows. If an element x belongs to the left-hand mem- 
ber of (1) it simultaneously belongs to A+B and C. But then x necessarily 
belongs to at least one of the sets A and B. For definiteness, let x € A, 
then x € AC and consequently the element x also belongs to the right- 
hand member of (1). Conversely, let x belong to the right-hand member of 
the equality; then x belongs to at least one of the sets 4C and BC. For 
definiteness, let x € AC; then x belongs both to A and to C and hence x 
belongs both to A+B and to C, that is it belongs to the left-hand member 
of (1). 

The definition of a sum of sets is readily extended to any finite and even 
infinite number of summands (eb 

The expressions- 


z 


Ay = Ait... +An and U Ay = 44,4424... 
k=l 


k=! 


denote respectively the collection of all the elements of the sets Ai, ..., Aw 
and the collection of all the elements of the sets 441, 4», ... and are referred 
to as the unions or sums of the indicated sets. 

There hold the equalities 


C ÙJ 4 = (cA. and c^ = Üc^ 


k=1 k=1 k=1 


(analogous to (1) in the case of the sign “+”) where C is an arbitrary set. 
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Examples 
(i) [0, 2] -- [1, 3] = 10, 3]; Gi) [0, 2]— [1, 3] = [0, 1); (iii) Ü [k, k+1] = 


k=- œw 


= Ü [k, k+1) = R where R is the set of all real numbers. 


k=- œ 
§ 1.3. Function 


Let E be a set of numbers and let there be given a certain law according 
to which with every number x belonging to £ a (single) number y is asso- 
ciated. Then we say that there is a (single-valued or one-valued) function 
defined on E. In this case we write 


y-f() (EE) (1) 


This definition of a function was suggested by N. I. Lobachevsky and P. G. L. 
Dirichlet*. The set E is called the domain of definition (or, simply, the domain) 
of the function f (x). We also say that we are given an independent variable 
x which can assume the particular values x belonging to the set E and that, 
according to the given law, to each x € E there corresponds a certain value 
(number) of the other variable y called a function or a dependent variable. 
The independent variable is also called the argument. 

The concept of a function can be interpreted in geometrical terms. 
We say that there is a set E of points x of the real line called, as was said, 
the domain of definition of the function and a law associating with every 
point x € E a number y = f(x). 

If we speak of a function as a certain law of correspondence associating 
with each number x € E a number y it is sufficient to denote the function 
by a single letter f. The symbol f (x) denotes the number y which, in accord- 
ance with that law f, corresponds to the value x € E. For instance, if the 
number 1 belongs to the domain of definition E of a function f then f(1) 
is the particular value of the function f at the point x = 1. If 1 does not 
belong to E (i.e. 1 € E) we say that the function f is not defined at the point 
x=1. 
The set E, of all the values y = f(x) where x € E is called the. image 
of the set E (produced by the function f) or the range of the function y = f(x): 
for x € E. In such a case we sometimes write £, = f (E). In using the latter 
notation care should be taken not to confuse it with the notation y = f(x) 
where x is an arbitrary number (point) belonging to the set E and y is the 
corresponding point, of the set E;, assigned to x by the function (law) f; 
to this end it is advisable to make the necessary stipulation every time the 
symbolic relation E, = f (E) is used. We also say that the function f maps 
the set E on the set E1 and sometimes synonymously call f a mapping. 

If E, = f (E) C A where A is a set of numbers which, in the general case, 
may not coincide with Ei we say that f performs a mapping of E into A. 


*N. I. Lobachevsky (1792-1856), the great Russian mathematician, the creator of the 
non-Euclidean geometry. P. G. L. Dirichlet (1805-1859), a German mathematician. 
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For two functions f and 9 defined on one and the same set E we define 


the sum fg, the difference f— p, the product fq and the quotient L. These 
are new functions expressed respectively by the formulas " 


fe)*eG) S@)-90), fe. JO, xeg , Q 


where in the case of the quotient it is supposed that (x) = 0 on E. 

Any other letters F, Ø, !P, ... can also be used to denote functions, and 
instead of x and y we can write Z, u,v, W, .... 

If a function f maps a set E into E; and a function F maps the set E; 
into a set E», the function z = F(/(x)) is called a composite function or a 
function of a function or the superposition of the functions fand F. This new 
function is defined on the set E and performs a mapping of E into E>. 

A composite function can also be constructed as a superposition of any 
number n of functions: z = F (FoF. . (F(x)... JJ 

In practice we encounter many examples of functions. For instance, the 
area S of a circle of radius r is a function of the radius r expressed by the 
formula S = zr?. This function is obviously defined on the set of all positive 
numbers r. 

The dependence of a variable S on a variable r expressed by the formula 
S — zr? can be considered irrespective of the question of computing the 
area of a circle. The function S = ¢(r) specified by this formula is defined 
throughout the real axis, that is for all real numbers r, not necessarily for 
positive ones. 

Below are examples of functions determined by formulas: 


y=- (iy y= 22) 


x-i 
(i) y = log (1+x) (v) y = arcsin x 
, Gü) y= x-1 
Here we mean real functions assuming real values y for the corresponding 
real values of the argument x. It is readily seen that the domains of definition 
of these functions are, respectively, oe. 

(i) the closed interval [—1, 1] = (—1 =x = I}; 

(ii) the set x > —1; 

(iii) the whole real axis; 

(iv) the whole real axis with the point x = 1 deleted; 

(v) the closed interval [ — 1, +1]. 

'The functions in examples (i) and (ii) can be regarded as composite func- 
tions: (i) y = Vu, u = 1—v, v = x*; (ii) y = log u, u = 14x. 

The construction of the graphs of functions is an important method of 
representing functions. Let us take a rectangular coordinate system x, y 
(Fig. 1.1). Marking a closed interval [a, b] on the x-axis we plot an arbitrary 
curve I" possessing the following property: for any point x € [a,b] the 
straight line parallel to the y-axis and passing through this point meets the 
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Fig. 1.1 


curve I’ at exactly one point A. A curve of this kind specified in a rectangular 
(Cartesian) coordinate system will be referred to as a graph. The given 
graph determines a function y = f (x) on the interval [a, b]: if x is an ar- 
bitrary point of the interval [a, b] the corresponding value y = f (x) of the 
function is determined as the ordinate of the point A (see Fig. 1.1). Thus, by 
means of the graph we have obtained a definite law of correspondence 
between x and y = f(x). 

We have defined, by means of a graph, a function on the set E which is a 
closed interval [a, b]. In other cases E can be an open interval, a half- 
interval, the whole real axis, the set of rational points belonging to a given 
interval and the like. 

Let us take a function f(x) defined on an interval (a, b) and an arbitrary 
(constant) number æ + 0. Using « and f we can construct a number of other 
functions: (i) «/(x); (ii) f(x) +e; (iil) f(x —&); (iv) /(«x). Functions (i) and 
(31) are defined on the same interval (a, b). The ordinates of the graph of 
function (i) are « times the corresponding ordinates of the function f(x). 
The graph of function (ii) is obtained from that of f by moving the latter 
graph œ units of length upward"; as to the graph of function (iii), it is 
obtained from the graph of f by shifting the latter by a distance of a to the 
right. Finally, function (iv) is obviously defined, for æ > 0, on the interval 
($, 2); its graph is obtained by ana-fold uniform contraction of the graph 
of f. 

A function f is said to be even or odd if it is defined on a set symmetric 
with respect to the origin and if it possesses, respectively, the property 
f(—x) = f(x) or f(x) = -f (x). l 

The graph of an even function is apparently symmetric about the y-axis 
while the graph of an odd function is symmetric about the origin. For 
example, x?* (where k is a natural number), cos x, In |x|, V1--x?, f(Ixl) 


are even functions while x?**1 (where k = 0 is an integer), sin x, xy 1-- x? 
and xf(|Kx|) are odd ones. 


. .* [n the case æ < 0 the motion of the graph upward by a distance of a (the shift to the 
right by a distance of a) should be of course understood as the motion downward by |«| 
(the shift to the left by | a). 
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It is easily seen that the product of two even or of two odd functions is an 
even function and that the product of an even function by an odd function is 
an odd function. 

Most of the functions are of course neither even nor odd. 

A function can be specified by different formulas on different parts of 
its domain of definition. For instance, suppose that a train departs from 
station A at time moment ¢ = Oand travels for two hours with a speed of 
100 km per hour, arrives at station B where it has an hour stop after which 
it travels for three hours at 80 km per hour. Then the function s = f (t) 
expressing the distance (measured in kilometres) from the train to the station 
A at time moment / is obviously determined with the aid of the following 


three formulas: 
100 t (0 == 2) 


f(t) = {200 (2 <1 <3) 

200--80((—3) (3 <1<6) 
A function can be specified by a table. For instance, if we measure the 
air temperature T every hour during 24 hours then to each time moment 


t = 0,1, 2, ..., 24 there corresponds a definite number T, the variation of 
T being determined by a table of the form 





We thus obtain a function T = f (À, defined on the set E of integers from 
0 to 24 represented by this table. 

If a function » = f(x) is defined on a set E by means of a formula we 
can always speak of a definite graph specifying this function geometrically. 
The converse is by far not always so clear: the question as to whether a 
function specified by an arbitrary graph can be expressed by a formula is 
rather difficult. To answer it we should define more precisely what is meant 
by the word “formula”. Above, when we spoke of a given function y = f(x) 
determined by a formula, we supposed tacitly that y can be obtained from 
x by a finite number of such operations as addition, subtraction, multiplica- 
tion, division, extraction of the Ath root with a certain index k, taking 
logarithms, performing the operations symbolized by sin, cos, arcsin and 
other algebraic and trigonometric operations. 

Mathematical analysis provides certain means for an essential generaliza- 
tion of the notion of a formula. An important operation of that kind is the 
expansion of a function in an infinite series with respect to elementary 
functions. 

Many, if not all, functions encountered in practice can be represented by 
a formula of the type of an infinite series whose terms are elementary func- 
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tions defined later; the notion of a series will be defined later on and now 
we shall not speak of it since we are not yet ready to discuss this question. 

In any event, irrespective of the way in which a function /(x) is specified, 
by a formula, or a graph or in some other way, it can serve as the object 
to which the methods of mathematical analysis can be applied if it satisfies 
some additional general requirements, such as continuity, monotonicity. 
convexity, differentiability and the like. But these questions will be discussed 
later. 

An important notion which is used in the investigation of functions is that 
of a limit; the notion of a limit is one of the most important in mathematical 
analysis. The next chapter is devoted to the study of this notion. 

If to each number x belonging to a given set E of numbers there corres- 
ponds, in accordance with a certain law, a definite set e, of numbers y we 
say that this law of correspondence determines a many-valued (multiple- 
valued) function y = f(x). If it turns out that for every x € E the set e, 
only consists of a single number y we obtain, as a special case, a single- 
valued (one-valued) function. 

A one-valued function is often simply spoken of as a "function" without 
the adjective *one-valued" when this does not lead to a misunderstanding. 

In algebra and trigonometry we often deal with multiple-valued functions; 
such are, for instance, Vx, Arcsin x, Arctan x, etc. 


The function Vx is defined for x = 0. It is two-valued" since to every 
positive number x there correspond two real numbers differing in sign whose 
squares are equal to x. As to the function Arcsin x, it is infinite-valued. In 
the functional relationship established by the latter function to each value 
x belonging to the closed interval [— 1, +1] there corresponds an infinite 
set of numbers y which can be written by means of the formula 


y= (—1) arcsin x+kx (k=0,1,2,...) 


Our discussion concerned functions of one variable but we can also speak 
of functions of two, three and, generally, n variables. 

The notion of a function of two variables is introduced in the following 
way. We consider a set E consisting of pairs of numbers (x, y). Here are 
meant ordered pairs: two pairs (xi, yi) and (x», Y2) are regarded as equal 
(coinciding) if and only if x; = x» and yı = y». If there is a certain law 
which assigns to every pair (x, y) € E a number z we say that this corre- 
spondence specifies a function z = f(x, y) of the two variables x and y on the 
set E. 

Since to every pair of numbers (x, y) there corresponds a definite point 
with coordinates x and y, in the plane where the Cartesian coordinates x 
and y are introduced and, conversely, to each point there corresponds a 


È 
* By the way, in what follows the symbol Vx (k = 2, 3, .. .) will always be understood, 
unless otherwise stated, as the arithmetic kth root of x = 0, that is as a nonnegative num- 
ber whose Ath power equals x. 
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pair (x, y), we can say that the function z = f(x, y) is defined on a set E 
of points lying in the plane. ] 

Taking a three-dimensional space with rectangular coordinates x, y and z 
we can represent a function z = f(x, y) of two variables by the locus of 
points (x, y, f(x, y)) whose projections (x, y) on the coordinate plane xy 
belong to the domain of definition E of the function f. 

For instance. if we take the function 


z-yI-xX-y5 xuyxl 


the corresponding locus is the upper hemisphere of radius 1 with centre at 
the origin. 

A function of three independent variables can be defined in a similar 
way. In this case the domain of definition is a set E consisting of ordered 
triples of numbers (x, y, z) or, which is the same, the set of the corresponding 
points of a three-dimensional space where a Cartesian coordinate system 
is introduced. 

If to every triple of numbers (i.e. to every point of the three-dimensional 
space) (x, y, z) belonging to E there corresponds, in accordance with a certain 
law, a number u we say that this correspondence determines a function 
u = F(x, y, z) defined on the set £. 

Similarly, we can consider a set E of ordered n-tuples (xi, ..., Xn) con- 
sisting of n numbers where n is a given natural number. Again, if to each 
such n-tuple belonging to E there corresponds, according to a certain law, a 
number z we say that z is a function of the variables x, ..., x, defined on 
the set E and write z = F(x, ..., Xa). 

In the case n > 3 we no longer have at our disposal a real (geometrical) 
n-dimensional space which can be used for the visual representation of the 
n-tuples (xi, ..., Xn) as points belonging to that space. But mathematicians 
invented the concept of an n-dimensional space which successfully serves 
this purpose and not worse than the real geometrical three-dimensional 
space. Namely, by an n-dimensional space is meant the collection of all 
n-tuples (x1, .. ., Xn) (See § 6.1). 

If two functions f and of n variables are defined on one and the same 
set E of n-tuples (x1, . - -, x4) (which are regarded as points of the r-dimen- 
sional space) the sum f+q, the difference f—ọ, the product fp and the 
quotient f/p are specified, as functions defined on E, by means of equalities 
analogous to (2), the only distinction being that the numbers x should be 
replaced by the n-tuples (x1, - - ., Xa). Composite functions such as f(g(x, y), 
p(x, y, z)) = F(x, y, z) where (x, }, z) are triples of numbers belonging to 
a certain set of triples are also defined in a natural manner in the case of 
three and, generally, n variables. 


Example 1. The expression u = Ax+By+Cz+D where A, B, C and D 
are given constant real numbers is a linear function of three variables x, y 
and z. It is defined throughout the three-dimensional space. A more general 
linear function of n variables x1, ..., Xn is specified by the formula u = 
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n 
= Y axı+b where ai, ...,a, and b are given constant numbers. This 
i=1 
function is defined at any point (x1, ..., Xa) of the n-dimensional space or, 
as we say, throughout the n-dimensional space. 


Example 2. Consider the formula z = log V/1—x?—y?. It determines a 
function defined in the domain of the shape of a circle (disc) of radius 1 
with centre at (0, 0) with all the boundary points, which are the points of the 
circumference of the circle, deleted. For the latter points the function is not 
defined since log 0 does not make sense. 


Example 3. The function 


:jfüje n for y20 


1 for y «0 


is represented geometrically by two disjoint parallel half-planes, their dis- 
position with respect to the coordinate system being quite obvious. 
A function of one variable can be determined implicitly by an equality 


F(x,y) = 0 (3) 


where F is a function of the two variables x and y. 

Let a function F be defined on a set G of points (x, y). Equality (3) spec- 
ifies a subset 2 of the set G on which the function F is equal to zero. Of 
course the subset 2 can be empty. Suppose that 2 is a nonempty set, and 
let E be a set (obviously nonempty) of tbose values (numbers) x to each of 
which there corresponds at least one y such that the pair (x, y) belongs to 2. 
The set E thus consists of all numbers x to each of which there corresponds 
a nonempty set e, of numbers y such that (x, y) € Q or, which is the same, 
such that for the pair (x, y) equality (3) is fulfilled. This determines on the. 
set E a function y = (x) of x which, in the general case, is many-valued. 
In such a case we say that the function g is defined implicitly by means of 
equality. (3). It obviously satisfies the identity 


F(x,g(xX) 20 forall x€ E 


By analogy with the above, we can also define a function x = p(y) of 
the variable y specified implicitly by equality (3). For this function there 
holds the identity 


F(y(y),y) = 0 forall y € E, 


where E; is a set of numbers y. We also say that the function y = p(x) 
(or x = v(y)) satisfies equation (3). The function x = y(y) is called the 
inverse function of the function y = p(x). 
Example 4. The equation 
X+ = r (4) 
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where r > O determines implicitly the two-valued function of one variable 
y-ryrtx? (—rsexsr) 


which, by the way, is one-valued for x = tr. 

It is natural to regard this two-valued function as splitting into two con- 
tinuous one-valued functions y = +)r?—x? and y 2 —yr?—x? (—r = x = 
«r). The locus formed of their graphs (which are the upper and the lower 

' semi-circles) is the circle of radius r with centre at the origin. This circle is the 
collection of the points whose coordinates x and y satisfy equation (4). 

Let us proceed to the general case of n dimensions. Let a function F(x;,. . ., 
Xn) be defined on a set G of points (x1,. . ., Xn) of the n-dimensional space of 
n-tuples (x1,. . ., Xn). The equality 


F(x, Xa, <., Xn) =0 (5) 


determines a subset Q of the set G on which the function F is equal to zero. 
Let the set 2 be nonempty and let E be the set (also nonempty!) of those 
n-tuples (x1,..., X41) to each of which there corresponds at least one value 
x, SO that the point (x1,. . ., x,) belongs to 2. Thus, E is the set of all (n— 1)- 
He (xa. .., Xn—1) to each of which there corresponds a nonempty set 

ies of numbers x, such that (x1, ..., Xn) € Q or, which is the same, 
crm that for (x1. . ., Xn) there holds equality (5). This specifies on the set E 
a function x, — 9x. . +» Xn—1) dependent on (x1,. . ., x4 1) which is mutiple- 
valued in the general case. In such a case we say that the function g is defined 
implicitly by equality (5). For this function the identity 


F(x, e.. Xn-1, gx, ere Xn-1)) = 0, (x1, EE Xn-1) € E 
obviously holds. 


E Elementary Functions 


1. The constant function C. Here to each real number x there corresponds 
the value y equal to one and the same number C. The graph of this function 
. (in a. rectangular coordinate system) is a straight line parallel to the x-axis 
' passing at a distance of |C| from the x-axis and lying above the x-axis if 
C > 0 and below it if C < 0. 

2. The power function x" (n = 0, +1, £2, ...). For positive integral n the 
function x^ is defined throughout the real axis. For negative integral n it is 
defined over the whole real axis with the point x = 0 deleted. It should be 
noted that it is inconvenient to regard 0° as a definite number (see § 5.14). 
Of course, if we deal with the function y = x? it may turn out to be conveni- 
ent to put 0? = 1 because, under this convention, this function will possess 
a continuous graph (which is a straight line parallel to the x-axis) for all 
values of x. 

In Fig. 1.2 we see the graphs of the functions y = x, x2, x? and xt. 

3. A polynomial of the nth degree is a function of the form 


P(x) = ao aix ... t ax" 
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Fig. 1.2 


where do, @1,..., @, are constant coefficients and n is a given natural number. 
A polynomial of degree z is obtained from the constants a,(k = 0,..., n) 
and from the functions x, x2,. .., x" by means of a finite number of arith- 
metical operations, namely by means of addition, subtraction, and multi- 
plication. 

A polynomial is also termed an entire rational function (of degree n). Its 
domain of definition is the entire real axis. 

4. By a rational function is meant a function of the type 

— Po) 
R(x) = QU) 
where P(x) = ao4- ;.. +a,x" and: Q(x) = bo-- bix-- b,x" are some poly- 

A rational function is defined for all x lying on the real axis for which 
Q(x) = 0. Thus, it is not defined only at the zero points (roots) of the poly- 
nomial Q, that is at the points x such that Q(x) — 0. The number of such 
points does not exceed the number m. 

A rational function is obtained from some constants and from the func- 
tions of the form x* (kis a natural number) by applying to them (a finite num- 
ber of) arithmetical operations, that is by means of addition, subtraction, 
multiplication and division. 

5. The power function x^" (where a is a constant number, not necessarily 
integral) is known to the reader from elementary mathematics. But in ele- 
mentary courses of algebra not all properties of this function are given a 
rigorous justification. For example, the definition of x? in the case when a is 
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an irrational number involves some subtle notions of the theory of limits. 
After the theory of limits has been studied we shall return to the function x^ 
and give its rigorous definition and the proofs of its properties. 

6. The exponential function a* (a > 0). This function is also studied in 
elementary courses of mathematics. It should be noted that, as in the case of 
the power function, not all definitions and properties connected with the 
exponential function are rigorously treated in elementary courses. Therefore 
later on we shall come back to this function. The inverse function of a* is the 
logarithmic function log, x. 

T. The function sin x is known to the reader from trigonometry where it is 
defined on the basis of geometrical considerations. We shall remind the 
reader of the definition of sin x. Let us set a number x and lay off the arc 
length |x] on the circle of radius 1, from the initial point A (Fig. 1.3), in 
the counterclockwise direction if x > 0 and in the clockwise direction if 
x < O. The arc length is meant to be measured in radians. Let B be the end 
point of this arc. Then the length of the perpendicular BC to the line OA ta- 
ken with the sign “+” if B lies above OA and with the sign *— " if B lies 
below OA is equal to y = sin x. 

As the reader knows, the functions cos x, tan x, cosec x, sec x and cot x 
are defined and studied in a similar way. 

Proceeding from the trigonometric function we define the inverse trigono- 
metric functions Arcsin x, Arccos x, etc. 

The functions enumerated in 1-7 are called the basic elementary functions. 
Any function formed of basic elementary functions with the aid of the opera- 
tions of addition, subtraction, multiplication, division and superposition of 
functions (i.e. forming composite functions) i is called an elementary function 
if the number of the indicated operations is finite. It is a function of this type 
which is said to be specified by a formula. 





Fig. 1.3 
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Fig. 1.4 


Examples of elementary functions are sin x?, (sin x), tan log y 1— xê, cos 17 
arccos x and x* = a* ^s. * (q > 0). 

Polar Coordinates. Let us choose in a plane a ray OL (the polar axis) 
issued from a point O (the pole; sec Fig. 1.4). 

Now an arbitrary point A of the plane can be specified by the pair of num- 
bers (p, 0) called its polar coordinates where p is the distance from A to O and 
6 is the angle between OL and OA measured in radians. The pole O is a sin- 
gular point: it is specified by the pair (0, 0) where 0 can bean arbitrary angle. 
The angle 0 (the polar angle) is counted counterclockwise; o is called the 
polar radius. A function o = f(@) defined on an open interval (or on a closed 
interval or on an arbitrary set £) of values of 0 can be interpreted as the set 
of points (p, 0) in the plane for which 0 € E and o = f(0). There are many 
curves that can be conveniently described in polar coordinates by means of 
the corresponding functions o — /(0) (many-valued or one-valued). Let us 
consider some examples: (i) the function o = a? (a > 0, — œ < 0 =< œ) 
describes in polar coordinates the so-called Archimedes spiral (Fig. 1.5); (ii) 
the function 


— 9e | pecu is i 
2 = tos (0-0)? 0 € (6 z, +5), 2> 0 


describes a straight line such that the perpendicular dropped on it from the 
pole O is of length po and forms an angle of ĝo radians with the polar axis 


Fig. 1.5 
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(Fig. 1.6); (iii) the function 9 = 2cos 0 -5 AE 5) describes a circle of 
radius 1 with centre at the point A (1, 0) (Fig. 1.7). 


§ 1.4. The Concept of Continuity of a Function 


In Fig. 1.8 we see the graph of a function y = f(x) (a = x <b). It is na- 
tural to call this graph continuous because it can obviously be drawn by a 
continuous motion of the pencil without leaving the paper. Let us choose an 
arbitrary point (number) x € [a, b]. Another point x’ c [a, b] lying close to 
the former can be written as x’ = x+4x where Ax is a positive or negative 
number called the increment of the independent variable x. The difference 


Af = Ay = f(x x) f(x) 
is called the increment of the function f, at the point x, corresponding to the 
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O a X x+Àx b x 


Fig. 1.8 


increment Ax of the independent variable x. In Fig. 1.8 the quantity Ay is 
equal to the length of the line segment BC. Let us make 4x continuously tend 
to zero; then, for the function in question, Ay will also tend to zero: 


Ay —-0 (dx— 0) (1) 
Now let us consider the graph shown in Fig. 1.9. It consists of two disjoint 
continuous parts PA and QR. But these parts themselves are not connected 


continuously and therefore it appears natural to callthis graph discontinuous. 
For this graph to represent a one-valued function y = F(x) at the point xo let 





X9. X9*AX9 
Fig. 1.9 


us agree that F(xo) is equal to the length of the line segment joining .4 and xo; 
to indicate this convention we have shown A in the figure as bold-face point 
while the point Q is shown as placed at the tip of an arrow, which symbolizes 
that the latter point does not belong to the graph. If the point Q belonged to 
the graph the function F would be two-valued at the point xo. 

Now let us give xo an increment 4x9 and compute the corresponding 
increment of the function: 


AF = F(xo-4- Axo)— F(xo) 
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If Axo is made to tend to zero continuously we can no longer assert that AF 
also tends to zero. This is the case for the negative Axo tending to zero while 
for the positive Axo this is not so; as is seen in the figure, if Axo tends to zero 
retaining positive sign the corresponding increment AF tends to a positive 
number equal to the length of the line segment AQ. 

These considerations lead us in a natural way to the following definition 
(suggested by A. Cauchy). A function f defined on an interval [a, b] is said 
to be continuous at a point x belonging to that interval if the increment of the 
function at the point x, corresponding to the increment Ax* of the argument, 
tends to zero as Ax is made to tend to zero in an arbitrary way. This property 
of continuity of f at x is expressed by relation (1) and can also be written as. 

lim dy =0 (2) 


dx—0 


Relation (2) reads: the limit of Ay is equal to zero as 4x tends to zero ac- 
cording to any law. By the way, “according to any law” is usually omitted 
but is of course tacitly implied. 

If a function f defined on (a, b] is not continuous at a point x€ [a,b], that 
is if property (2) does not hold at x for at least one way of making Ax tend. 
to zero, the function f is said to be discontinuous at the point x. 

The function whose graph is shown in Fig. 1.8 is continuous at any point 
xE [a, b] while the function with the graph depicted in Fig. 1.9:is obviously 
continuous at any point x€ [a, b] except at the point xo since for the latter 
point relation (2) does not hold when Ax tends to zero retaining positive 
sign. 

The above definition of continuity is itself stated quite properly but the 
explanation we have given is based only on an intuitive idea of the concept. 
of a limit.. After the theory of limits has been presented this. definition, 
which can also be extended to the case of many independent variables, will 
receive full justification. 

A function continuous at every point of a closed (or open) interval is. 
said to be continuous on that interval. 

The continuity of a function expresses mathematically a property which is 
‘often encountered: in practice: to- a- small increment. of an..independent 
variable there also corresponds a small increment of another variable (func- 
tion) dependent on the former. Perfect examples of continuous functions are 
various laws of motion of physical bodies s = f(t) expressing the dependence 
of the paths s travelled by the bodies in time ¢. Time and space are continuous, 
and a given law of motion s = f(#) establishes between them a certain con- 
tinuous dependence whose characteristic feature is that to a small increment 
of time there corresponds a small increment of the path. ! 

_ We come to the abstract notion of continuity observing the so-called con- 
tinuous media, i.e. rigid bodies, liquids and gases, for instance, such as metals, 
water or air. Every real physical medium is in fact a collection of a large 


> Here is meant an increment Ax such that x+ Ax € [a, b). 
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number of discrete moving particles. But these particles and the distances 
between them are so small, compared with the volumes occupied by the 
media we deal with in considering macroscopic physical phenomena, that 
many of such phenomena can be approximated sufficiently well if we con- 
sider the masses of the media in question as being distributed in space con- 
tinuously without any “gaps” between the particles. Such an approach forms 
the basis of many physical disciplines, for instance, hydrodynamics, aerody- 
namics and the theory of elasticity. The mathematical concept of continuity 
naturally plays an important role in these and many other sciences. 

Continuous functions constitute the basic class of functions dealt with in 
mathematical analysis. 

Examples of continuous functions are the elementary functions defined in 
§ 1.3. They are all continuous on the intervals of variation of x where they 
are defined. 

Discontinuous functions which are also studied in mathematics describe 
jump-like processes observed in reality. For instance, the velocities of the 
colliding bodies change in a jump-like manner. Many processes of qualitative 
transition are accompanied with jump phenomena. For example, the de- 
pendence Q = f(t) between the temperature ¢ of 1 g of water (ice) and 
the number Q of calories of heat contained in it corresponding to the variation 
of t from — 10? to -- 10? is described, if we agree, conditionally, that Q = 0 
for t = — 10^, by the formulas 


Q(- 0.5t 4- 5 —10 «7-«0 
t-- 85 0 «mi < 30 


Here we have assumed that the specific heat of ice is equal to 0.5. The function 
Q = f(t) is not defined in a unique manner (that is it is multiple-valued) for 





Fig. 1.10 
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t= 0: Fo Ike of convenience we can agree that at the point ¢ = 0 it 
nea Dee a instance, f(0) = 45. The function Q = /(?) in 
question is obviously discontinuous at the point ¢ = 0; its graph is shown in 
Fig. 1.10. B 

$1.5. Derivative 


The notion of the derivative appears in the solution of the two old prob- 
lems of drawing the tangent line to a curve and computing the velocity of 
a nonuniform motion. Mathematicians have been interested in these prob- 
lems and also in the problem of computing the area of a curvilinear figure 
since ancient times. In the 17th century I. Newton and G. W. Leibniz com- 
pleted in a certain sense the solution of these problems. They created the gen- 
eral methods of differentiation and integration of functions and proved an 
important theorem (known as the Newton-Leibniz theorem) establishing a 
close relationship between the operations of differentiation and integration. 
But it should be noted that the modern understanding of these questions 
differs essentially from that in the times of Newton and Leibniz. In the con- 
siderations and notions used in those times there were many obscure and 
ambiguous ideas; the mathematicians of those times themselves realized this 
situation, which is testified by their heated argument about these questions. 

Modern mathematical analysis is based on the concept of a limit which 
assumed its rigorous and clear form comparatively not long ago—in the 
first half of the 19th century. The prominent French mathematician A. 
Cauchy should be particularly mentioned among those who contributed 
much to the development of this theory. 

The concept of a limit is essentially applied in the definitions of the notions 
of continuity, derivative and integral. 


‘Instantaneous velocity. Let a point move in a straight line and let a func-- 
tion s = f(z) express the dependence of its distance s, from an initial point 
O, taken with the corresponding sign*, on time ¢ € (a, b). At time moment - 
t € (à, b) the point is at a distance of s = f(t) from O. But at another time 
moment ¢+ Ar € (a, b) (At = 0) itis at a distance s+4s = f'(t4- Ar) from O. 
Its average velocity during the time interval (f, £-- /1r) is expressed as 

_ 4s f(t-A0—f(0 


Van = = = 


av Zt At 


The instantaneous (“true”) velocity v of the point at time moment ¢ can 
naturally be defined as the limit to which va, tends as At -> 0, that is 


: 4s 
v= lim —— 
4i—0 At 


.* More precisely, sis the coordinate of the moving point of the line on which an initial 
point O (the origin), a unit length and a positive direction have been indicated. 


34 A COURSE OF MATHEMATICAL ANALYSIS 


The average current intensity during this time interval is expressed as 


p 2 _ fit*40-ft 
a M` At 


The limit of this ratio as ‘It — O gives us the current intensity at the moment 
t: 
. 4Q 
i 1n 4t 

Derivative. All the three problems we have considered lead us to one and 
the same mathematical operation on a certain function although they 
belong to three different branches of knowledge—mechanics, geometry and 
the theory of electricity. This operation reduces to finding the limit of the 
ratio of the increment of a function to the corresponding increment of the 
independent variable as the latter tends to zero. The list of problems reducing 
to the same operation can be easily extended. In particular, the problem of 
computing the reaction rate or the problem of finding the density of a 
nonuniform mass distribution also leads to it. 

It appears natural that this operation is subject to a careful study in 
mathematics and is called by a special name: the operation of differentiation 
of a function. The result of this operation is called the derivarive. 

Thus, the derivative of a function f, defined on an interval (a, b), at a point 
x of that interval, is the limit to which tends the ratio of the increment of the 
function f, at this point, to the corresponding increment of the argument as 
the latter increment tends to zero. To denote the derivative we use the follow- 

“ing symbol": ; , 
" ; y -n Sæt Ax)— f(x) 
Lae n e 
df(x) 
dx ` 
The expedience of these symbols and their usage in various cases will 
become clear to the reader later on. 

The results of the examples considered above can now be stated as fol- 
lows: 

The velocity of a point which covers a path s whose dependence on time t is 
expressed by a function s = f(t) is equal to the derivative of this function 
with respect to time: s' = f'(). 

The tangent of the angle B between the tangent line to a curve, represented 
by a function y — f(x), at a point with abscissa x, and the positive direction 
of the x-axis is equal to the derivative f'(x). 





Some other types of notation are also used, for instance, y’, 2 and 


* If we consider the limit lim = only for 4x > 0 or only for dx < 0 the correspond- 
az—+0 


ing value of the limit is respectively called the right-hand or the left-hand derivative of fat the 
point x. When a function / defined on a closed interval [a, b] is said to have a derivative 
at every point of that interval it is meant that the function possesses a derivative at every 
point of the open interval (a, b) and, besides, has a right-hand derivative at the point a and 
a left-hand derivative at the point b. 
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If a function Q = f(t) expresses the charge of electricity passing through a 
section of a conductor in time t, the intensity of current I in the conductor 
. > a 
at a time moment t is equal to the derivative of Q with respect to t: 1 = Q' = 
= f'(). 
Some formulas. For any natural n = 1,2, ... we have 
(x^)! = nx"? (1) 


Indeed, denoting lx = h we can write, according to Newton’s binomial 
formula (see also the remark at the end of this section), 





, S; A . Ll mo 
(x^) = lim —* = lim SEM .. 
tao " hi--0 h 

ling Lf ve um n(n—1l) ap HZ Roms 

= m 3 (rene 1j 4- gr Wee... ch" x ) = 
= " n=l 

= ny"? p x77? lim A+... + (im n) = nx"! 
r2 h-+0 h-0 


where we have again used some elementary properties of limits which will 
be justified later on. 
There also hold the formulas 


(sin ax)’ = a cos ax (2) 
(cos ax)’ =—asin ax (3) 


where a is a constant. We shall prove the first of these equalities leaving the 
other to the reader: 


. ah 
sin =- 
ah 
cos {ax ES = 


. sin a(x-+A)—sin ax > 
lim SIn als Ee Se, iL lim |a 
heats h h—0 ah 
le] 
hæ 





. ah 
sin d 


- 





i , ah 
= alim lim cos (ax 7) = a-l1-cos ax = acos ax 
nao Hg 2 
^7 


In the last equality we have used the property lim M = | and the fact 
a—0 


that the function cos ax is continuous. Both assertions will be proved later 
on (see§§ 4.2 and 4.9). 

The derivative of a function f(x) is in its turn a function f'(x) of the 
variable x and therefore we can try to differentiate f'(x) as well. If the 
derivative of f'(x) exists it is called the second derivative (the derivative of the 
second order) of f(x) and is denoted as f" (x). 

The derivatives of higher orders f(x) of f(x) where n is any natural 
number are defined in a similar manner ( /*"(x) is called the nth derivative 
or the derivative of the nth order of f(x)). 


3* 
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The second derivative of a function s = {(#) expressing the law of motion 
of a point in a straight line is obviously equal to the acceleration of the 
point at time moment 1. 

What has been said indicates that the notion of the derivative plays an 
extremely important role in applied sciences and is one of the fundamental 
notions of mathematics. This will be confirmed Jater on. 

It should be noted that a constant number C regarded as a function of x 
(see § 1.3) possesses the zero derivative at all the points x (i.e. its derivative 
is identically equal to zero for all x). Indeed, 


f=C, f(xtdyy=C, C= lim € = limo=0 (4 


axo AX Ax—+0 


The converse is also true: if it is known that a function f (x) has a derivative 

identically equal to zero then 
fx) =0 

that is the function is equal to a constant. The rigorous mathematical proof 
of this simple assertion involves some comparatively complicated techniques, 
and we shall discuss them later on (see § 5.8). On the other hand, this is 
quite obvious from the point of view of mechanics: if, for instance, a func- 
tion s = f(r) expresses a law of motion of a point in a line and if it is known 
that the velocity of the point is identically equal to zero, that is v = /'(t) = 0, 
it is evident that the point is in a state of rest and its distance s from the 
origin O is constant for any 1. In this argument we have replaced x by t 
but this is inessential since the time can be denoted by x as well. 

We also note that if two functions u(x) and v(x) possess derivatives at a 
point x and 4 and B are constant numbers, then the function 


f(x) = Au(x)- Bv(x) (5) 
also possesses a derivative equal to 
f(x) = Au'(x)- Bo'(x) (6) 
Indeed, 
lim f(x - h)- f(x) Sin Au(x +h) + Bo(x+ h) — (Au(x) + Bu(x)] B 
h—0 ! h—0 h 
_t u(x v h)— u(x) . v(xth)—-v(x) — 
= lim (4 h )* im (2 h )= 
= Alim “t-e , p lim rm = Au'(x)+Bo'(x) (7) 
h--0 h-0 


In the second equality in this chain of equalities we have used the fact that 
the limit of a sum is equal to the sum of the corresponding limits and in 
the third equality we have relied on the rule that a constant can be taken 
outside the sign of limit. 
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By induction we can readily prove the general assertion* 


n M n 
(X apo) = Y ajuj(x) 
Jal j=l 
where a; are constant numbers and the functions uj(x) are supposed to have 
derivatives. 


Tn particular, for the derivative of a polynomial we obtain 


(X a) = Y kayxk} 
k=0 1 


(ax are constants). 


Remark. The formula (x") = nx"! (n = 1,2, ...) can be proved 
without resorting to Newton’s binomial formula. For n = 1 we have 


F Xth-x 
x = lim —— 


- = 1 = x? 
h—0 h 


If we now suppose that the formula (x"^')' = (n— 1)x""? (n = 2, 3, ...) is 
valid we readily obtain (see § 5.1 (5)) 
(x) = (xx73y' = x'xt7 lya" = nx} 


We also advise the reader to look through formulas (4)-(9) in § 5.1 and 


the table in $5.5 since they can be of use to the reader before he reaches 
these sections in the gradual study of the subject-matter. 


8 1.6. Antiderivative. Indefinite Integral 


Let f be a continuous function defined on an open interval (a, b). By 


definition, a function F is called an antiderivative of f on the interval (a, b)** 
if the derivative of F is equal to f on that interval: 


F(x) =f)  (xt(ab) 


It is quite obvious that if F is an antiderivative of f on (a, b) then the 
function F(x)+C where C is a constant is also an antiderivative of f because 


(F(x)-O)' = F'(x)--C' = F(x) = f(x) 

Conversely, if F and F, are two antiderivatives of f(x) on (a, b) their dif- 
ference is necessarily equal to a constant C throughout the interval (a, b): 
Fi(x) = F(x)-C 


* Here we usc the notation 


(1) 


» n 
tat ...+a,= Pa, = ja, 
j=l 1 


** An antiderivative of f on a closed interval (a, b] is defined similarly (but in this 
connection one should take into account the footnote on p. 34). 
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Indeed, uU (x) - F(x)) = Fi) — F(x) = f(x) — S (x) = 0. Now remember 
(see the foregoing section) that (Fi(x) — F(x))' = 0 implies that there is a 
(constant) number C such that Fi(x) — F(x) = C on (a, b) whence follows (1). 

Thus, using purely mechanical considerations we have established the 
important fact that if F is an antiderivative of f on an interval (a, b) then all 
the possible antiderivatives of f on that interval are expressed by the formula 
F(x)-- C where any number can be substituted for C. 

Now we state the following definition. 

The indefinite integral of a continuous function f defined on an interval 
(a, b) is an expression which gives the general form of all the antiderivatives 
of f, that represents any arbitrary antiderivative. The indefinite integral is 
denoted as 


i f(x) dx 


It follows from what has been said that if F is a certain antiderivative of f 
on an interval (a, b) then the indefinite integral of f on that interval is written 
as 


f fdx = F(x)+C (2) 


where C is an appropriately chosen constant. 

If fı and f» are continuous functions on an interval (a, b) and A; and As 
are constants then there holds the following equality expressing the basic 
property of the indefinite integral: 


f 09 42/209) dx = A [AGO dx+ Aa |f dC (3) 


where C is a constant. 
Indeed, by the definition of the indefinite integral, the left member of (3) 


is one of the antiderivatives of Afi) + Afal). On the other. hand we 
have the equality 


(Aa [A09 dat Aa [869 dx) = Aaf f AO dx) + Aaf f 500 ae . 
- Asfi) + Anf) (4) 


because the integrals J Ai dx and f f» dx denote, respectively, some antideriv- 


atives of fı and f2. Therefore the right member of (3), taken without the last 
term C, is also an antiderivative of 4;fi(x)-- Az2f2(x) and hence it differs 
from the left member of (3) by a constant. 

By induction, we readily extend property (3) to any number of continuous 
functions fi, ..., f, defined on the interval (a, b) and any constants Aj, 


eons ne 


f (X Ai) dx z^ Ay [69 dx+C (5) 
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As consequences of (5), we obtain for 4; = 1, A, =+1 and n = 2 the 
equality 


[EA dx = [f dx [5 dc 
and for Ay = A, 4» = O and fı = f the equality 
[Aras = A | fdx+C 





Examples 
f xm dx = TC, n=1,2,... (6) 
f cos ax dx = ie, C, a#o0 (7) 
f sin axdx 2 -9 "4C, a=0 (8) 


Indeed (see $1.5 (1), (2), (3)) we have 
Espey =e 


n 





sin ax |' Lips j ] 
e = Gin ax) = 7 4 COS ax = cos ax 





cos ax \’ l i 
(- à ) =- z (cos axy = sin ax 


From o and (6) it follows that the indefinite integral of a polynomial 


-P a(x) = Fat of degree n (a, are constants) is expressed by the formula 


[ Pale) dx = Xeinec 


§ 1.7. The Concept of Definite Integral. 
The Area of a Carvilinear Figure 


Let us take a nonnegative continuous function f(x) defined on an interval 
[a, b] (a and b are finite numbers). Its graph is shown in Fig. 1.14. Now we 
pose the following problem: it is required to define the notion of the area 
of the figure bounded by the curve y — f(x), by the x-axis and by the 
straight lines x — a and x — b and to compute this area. It is natural to 
solve this problem as follows. 

Let us partition the closed interval [a, b] into n parts by means of points 
of division 

a=xX<x<...<x%,=5b (1) 
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Fig. 1.14 


and choose on each of the subintervals 
[x;, Xj41] (j= 0, 1, So, n-]) (2) 


thus obtained an arbitrary point £j, € [x,, xj4:]. Next we find the values 
f(&j) of the function fat these points and form the sum 


Sa = y (£j) Ax), (Ax, = Xy41—%;) (3) 
0 


which is termed an integral sum and which is obviously equal to the sum of 
the areas of the shaded rectangles in Fig. 1.14. 

` Now let us make all 4x,’s tend to zero in such a way that the maximum 
subinterval (i.e. that having the greatest length) tends to zero. If in this 
limiting process the sum S,, tends to a definite limit S independent of the 
ways in which partitions (1) are made and of the choice of the points &, 
on the subintervals, it appears natural to regard the quantity S as the area 
of the curvilinear figure in question. Hence, 


S= lim 'y/()4x (4) 
max 4x40 Q 


We have thus stated the definition of the area of the curvilinear figure. 
Now there arises the question as to whether every such figure possesses 
area, that is whether the corresponding integral sum S, does in fact tend to 
a finite limit when max |4x;| — 0. Later on we shall show that the answer 
to the question is affirmative: every curvilinear figure of the type defined 
above which corresponds to a continuous function f(x) does in fact have 
area, in the sense of the definition we have stated, which is expressed by 
a number S thus depending on that figure. 

Another important question is to what extent this definition is natural 
from the point of view of human experience. As usual, such a question should 
be answered on the basis of practice. Here we limit ourselves to saying that 


INTRODUCTION 41 


this definition is really justified by practice. In what follows we shall many 
times have a chance to see that the stated definition is expedient. 

Now let us examine expression (4) itself abstracting from the concrete 
conditions of the problem of computing area. We can regard (4) as an opera- 
tion by means of which a certain number S is found from the given function 
f defined on [a, b]. This operation is called definite integration, and its result, 
provided it exists, is called the definite integral of fon [a, b] and is written as 


b 
S= lim Sf) dx, = [S/O dx (5) 


mox dx,—-0 j=0 


Thus, by definition, the definite integral of the function f on the interval 
[a, b] is the limit of integral sum (4) as the maximum subinterval of partition 
(1) tends to zero. 

In this definition which is no longer connected with the problem of com- 
puting area we do not suppose that the function fis necessarily continuous 
and nonnegative on [a, b]. It should be noted that the definition does not 
assert the existence of the definite integral for any function f defined on 
[a, b], that is it does not guarantee the existence of limit (5). It only says that 
if this limit exists for the given function f defined on the interval [a, b] it 
is called the definite integral of f on [a, b]. 

We must also take into account that when this limit S is said to exist it is 
meant to be independent of the ways in which the interval [a, b] is partitioned 
and of the choice of the points £; belonging to the subintervals obtained. 

1 


For instance, if it is known that the definite integral S = J f(x) dx of a 


0 
function f on the interval [0, 1] exists, it can be, for example, found by 
evaluating the limit 
F 1 n-l j 
dairy 
of the integral sums corresponding to the partitions of [0, 1] into n equal 
parts with the aid of the points x; = j/n (j= 0, 1, ..., n) and to the choice 
of the left end points of the subintervals of the partitions as the points £j. 
At the same time this number S can also be obtained as the limit 
n—l 5 s 
-—d JEMVA TURIS (jy? 
Seim EAERI] 
of the integral sums corresponding to the partitions of [0, 1] by means of 
the points x, = (j/n)? (j = 0, 1, ..., n— 1) and to the choice of the right end 
points of the subintervals of the partitions as £;. In this case the length of the 
jth subinterval satisfies the relations 


j+1\2 (qj ei 2-D£1 | 2n-1 2 1 
GG ete E NC 
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showing that the maximum of the subintervals (the rightmost) is of length 
which tends to zero together with an indefinite increase of n. 

In the theory of the definite integral it is proved that every function con- 
tinuous on a closed interval [a, b] is integrable on that interval, that is limit 
(5) exists for it. This implies that, as was mentioned, every figure of the 
type under consideration possesses area. 





Fig. 1.15 


Example. The area S bounded by the parabola y = v*, the x-axis and 
the straight line x — 1 (see in l. P is equal to 


mal ak 33 i 
s= in Uy im eo im i ren 
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" I I 
= um: (3-3 t ag) = 3 
We have shown that the integral sum of the function y = x* corresponding 
to the partition of [0, 1] into equal parts tends to the number 1/3. 
It is by far not so simple to prove by using elementary methods that the 


n—1l 


sum xj} Ax; corresponding to an arbitrary partition of [0, 1] tends to 1/3 
2 (x) Ax; p £g Typ 


when 1 max Ax, — 0. But this assertion is a consequence of the general pro- 
Position stated above which guarantees the existence of the definite integral 
of every continuous function on any (finite) closed interval. 

Let us consider some other examples of practical problems whose solu- 
tion reduces to the evaluation of definite integrals. 


Work. Let a point move in a straight line and let F = f(x), where f(x) 
is a continuous function of the abscissa x of the moving point, be a variable 
force directed along that line and applied to that point. The work performed 
by the force F as the point moves from a to b is equal to 


b 
W= lim » f(x) Ax; = f f(x) dx 


max dx,--0 j= 
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where a = xo < X1 < ... < X, = b, Àx; = xj41— xj. Indeed, by the con- 
tinuity of f, the product /(x,) Ax; is close to the true work performed on 
[x;, X;41] and the sum of these products is close to the true work, on the 
whole path [a, b], and tends to the latter as max 4.x, decreases. 


J 
The mass of a rod with variable density. Let us suppose that an interval. 
[a, b] of the x-axis carries a mass distributed with a variable linear density 
o(x) = 0 where g(x) is a function continuous on [a, b]. 
The total mass of this interval (of the rod) is expressed by tbe integral: 


n=l b 
M= lim ¥ o(x) dx; = | o(x) dx (6) 


max 4xj,—0 9 p 


a= Xo Np m l.l. om XO = D, slaj = xja-s 


The direct computation of a definite integral by means of formula (5) is 
connected with essential difficulties because the integral sums of even slightly 
complex functions usually have extremely lengthy and complicated expres- 
sions and it is often difficult to reduce them to a form admitting of the com- 
putation of the limits because there are no general methods for doing this. 
It is interesting to note that Archimedes was the first to solve a problem of 
this kind. Using some considerations which to a certain extent resemble the 
modern method of limits he managed to evaluate the area of a parabolic 
segment. Since then many mathematicians have been solving various 
problems on the computation of areas of figures and volumes of solids. 
Nevertheless, even in the 17th century the formulation of such problems 
and the methods of their solution were of particularly special character. 
An essential achievement was made by Newton and Leibniz who elaborated 
the general method for solving such problems. They showed that the com- 
putation of the definite integral of a function can be reduced to finding its 
antiderivative. 

Suppose that /(x) is a continuous function defined on [a, b], and let 
F(x).be its antiderivative. The Newton-Leibniz theorem asserts that there 
holds the equality 


b 
f f(x) dx = F(b)— F(a) (7) 


showing that if an antiderivative F of the function fis known the evaluation 
of the definite integral of f on [a, b] reduces to the simple substitution of a 
and b into F. 

The proof of this theorem will be given in § 9.9; here we shall present its 
simple mechanical interpretation. Let us regard x as time and suppose 
that a function y = F(x) expresses the law of motion of a point in a line, 
that is let y be the distance, taken with the corresponding sign, from the 
Moving point to a fixed point (the origin) at time moment x. 
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The path travelled by the point* during the time period a «x <b is 
obviously equal to 


A = F(b) — F(a) (8) 


On the other hand, the path can be evaluated by integrating the velocity 
I(x) = F'(x) of the point: 


b 
n—1l 
A= lim YJ/(x)4x- f f(x) dx (9) 
max Axy—0 j=0 z 
Indeed, the product /(x;) 4x; is an approximation to the path travelled 
by the point during the time interval [xj, Xj+1] where x, are defined as in 
ormula (1). Therefore (8) and (9) imply (7). 








Examples 
: wy 
Jya dx = >| = —(b"—a") (n x 0) 
b 200b 
f cos «x dx = “= | = 4 Gin ab — sin aa) (a = 0) 
a a 
b 


Here the notation F(x) | symbolizes the expression F(b)— F(a), that is 
F (x) 


= F(b) — F(a). 





| f 
The number of such examples can be essentially increased after the reader 

has studied $$ 5.1-5.5 which treat of the basic differentiation techniques for 

elementary functions. s 





bi It should be noted that the expression the “path travelled by the point” does not 
‘describe sufficiently precisely the phenomenon in question. For instance, if the law of 
Tnotton is such that the point first moves to the right travelling a path 4, and then moves 
to the left travelling a path A, then A = 4,- AQ. 


CHAPTER 2 


Real Numbers 


§ 2.1. Rational and Irrational Numbers 


In this chapter we give a review of the basic properties (expressed by 
axioms) of real numbers. In elementary courses of mathematics, where only 
arithmetical operations on constant numbers are considered, not all of these 
properties are adequately treated and therefore it is expedient to consider 
them here in more detail. These properties are particularly important for 
the study of variable numbers traditionally called variables. The investigation 
of functions involves all the properties of real numbers, not only those 
treated in elementary mathematics. 

The integers 


—2, —1,0, 1,2, ... (1) 


can be added together, subtracted from one another and multiplied by 
each other, the results of the operations being again integers. 

The rational numbers will be written as +p/q (+p/¢ = p/q) where p 
and q are integers, p = O (i.e. .p is greater than or equal to zero) and q > 0. 
Thus, unless otherwise stated, we regard p and q in an expression p/q as 
nonnegative integers. By definition, two rational numbers" :tpi/qi and 
+pe2/q2 are equal if and only if they have common sign and pig» = qip». 
The expression aoe specifies one and the same number 0 irrespective of 
the sign “+” ” and of the number q. Two nonnegative: numbers: 
Pilqi and pilie, afe connected by the relation 


Pr. Pe 
Nn 42 


if pıq2 < qıp2. It is well known how rational numbers with arbitrary signs 
are compared with each other and how the four arithmetical operations on 
them are performed and we shall not remind the reader of them*. 

For practical calculations it is quite sufficient to use only rational numbers. 
But numbers are also needed for measuring geometrical and physical magni- 


* The reader is supposed to be familiar with basic properties of rational numbers 
presented in elementary courses and therefore here we confine ourselves to a brief review 
without presenting the proofs. 
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tudes such as lengths of line segments, areas, volumes, temperatures and the 
like. Here we mean not practical approximate measurements but the precise 
(theoretical) representation of these quantities by numbers, and it is im- 
possible to give a theoretical justification of such measurements using only 
rational numbers. For example, let us consider a line segment representing 
the hypotenuse of a right isosceles triangle with unit legs. If we suppose 
that the length of this line segment is expressible by a positive rational 
fraction p/q (we suppose that it is in its lowest terms) the area of the square 
constructed on it will be equal to p?/g? while the areas of the two squares 
constructed on the legs of the triangle will be equal to 1. By Pythagoras' 
theorem we then obtain the equality p? = 29?.Its right member is an integer 
divisible by 2 and hence the left member must also be divisible by 2, and 
therefore p is an even number. It follows that the left member is divisible 
by 4; hence q? is divisible by 2, and so is q. Hence p and q have a common 
factor 2 which contradicts the assumption that the fraction p/q is in its 
lowest terms. Thus, there exist line segments whose lengths are inexpressible 
by rational numbers. Such line segments are said to be incommensurable 
with unit length. To represent their lengths? we need new numbers called 


irrational. This leads, for instance, to the appearance of the number y2 
expressing the length of the hypotenuse of the right triangle considered 
above. 

There are different ways of formal (logical) introduction of irrational 
numbers. Here we shall show how they can be defined by means of infinite 
decimals. 

Let us take an arbitrary positive rational number p/g. Applying the well- 
known rules of arithmetic we can bring it to the form of a decimal fraction. 
This results in 

Qs. G4... 
q Jp. (2) 
bo. 

5 


where æo is a nonnegative integer and a, (k = 1, 2, -..) are decimal digits. 
We shall write 


= 09.0149... = 4-49. Hye... (3) 


Al's 


and call the decimal fraction on the right-hand side of (3) the decimal 
representation of the number p/q. 

It can readily be shown that the decimal representation of a positive ration- 
al number is independent of the way in which the latter is written, that 1s 
if p and q in (2) are replaced, respectively, by p; and qı where pqi = pud 
the resultant decimal representation ao. &1«2. .. is exactly the same. 


. * A priori the length and the positive number are different notions but they are closely 
interrelated by the so-called isomorphism (see § 2.7). 
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As is well known from arithmetic, procedure (2) can lead to a decimal l 
representation of only one of the following two types; it must be either a 
finite (terminating) decimal 


È = ao. Z1.. dm = Hor E1 «tm 00... (Cm > 0) (4) 


or an infinite (also called nonterminating) repeating (or periodic) decimal 


1 = do. G1. Xf. Ber... Be... = Oo. 04. 2m (Ai.. Bo (5) 


In the latter case there appears, beginning with some decimal place, in 
expression (5) beginning with the (m+ 1)th place, a finite block of digits 
Bi. - . Bx (written in the parentheses on the right-hand side of (5)) repeating 
indefinitely, not all the digits £; being equal to zero. The periodicity of the 
decimal follows from the fact that the partial remainders f in expression 
(2) satisfy the inequality B, < q and therefore among the first q of them, 
i.e. among flo, Bi, .--» Pr- there must be two equal numbers. 
The first case can always be reduced to the second by putting 


= = Xe G1... Ly—1(%m — 1)99... (6) 


It follows that procedure (2), with the application, if necessary, of pro- 
cedure (6), sets up a one-to-one correspondence between the positive 
numbers p/q and infinite decimal fractions. 

We call a fraction zo. & 122. . . infinite if for every natural k there is a natural 
number | > k such that a, > 0. 

On the other hand, it is proved in arithmetic that te an arbitrary periodic 
decimal (5) there cerresponds a uniquely determined positive rational number 
plą such that procedure (2) results in exactly that decimal representation of 
this number. It should only be stipulated that if there appears a finite decimal 
fraction it must be transformed according to (6). "P 
-For instance, if the fraction. 103/330 is. subjected to procedure (2) the 
result is the (mixed) infinite repeating decimal - i b 
3.., 12 103 


E ahaa R A Ry OCC TRIES i et UNITS 
0.31212... = 0.3(12) = 10+ 590 = 330 
Conversely, by the first of the equalities considered above, the latter decimal 
is transformed into the original fraction 103/330. 
With a negative rational number —p/q we associate the representation 
of the number p/q as infinite decimal taken with the sign * — ". 
Thus, there is a one-to-one correspondence* +p/q = tao. a«ix2xs... 
between the nonzero rational numbers and repeating infinite decimals. 


* If to each element x of a set A there corresponds a definite element y of a set B so 
that every element y € B corresponds to exactly one x € A we say that there is a one-to-one 
correspondence between the elements of A and B and write A > x = y € B. 
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These procedures assign to every nonzero rational number a uniquely 
determined representation of the number as periodic decimal. Conversely, 
every such decimal corresponds, in accordance with the procedures, to a 
nonzero rational number. 

It appears natural to attribute to the number zero (which is also rational) 
the decimal representation 0 = +0.00 ... = 0.00 .... 

Besides periodic decimals there exist nonperiodic ones, for instance, 
0.1010010001 ... and 0.121122111222 .... 

Here is another example. If we extract the square root of 2 following the 
well-known arithmetical rule the result is the infinite nonrepeating decimal 


y2.— 1.41 .... This decimal is completely defined in the sense that to any 
natural number & there corresponds a definite kth decimal digit « of the 
number V2 which is uniquely determined by the rule for extracting square 
roots. 

Mathematical analysis provides many methods for computing the number 
æ with any preassigned accuracy. This results in a quite definite decimal 
representation of z which turns out to be a mixed nonperiodic decimal 
fraction. 

Now we state (at the present stage—quite formally) the definition of an 
irrational number. By an irrational number is meant an arbitrary nonperiodic 
infinite decimal fraction 

a= +a. Z1]XoX3 ... (7) 


where «s is a nonnegative integer and a, (k = 1,2, ...) are decimal digits, 
the meaning of the equality sign “=” being that the right member of (T) is 
denoted by a. On the other hand, it is convenient to say, simply, that the 
right member of (7) is the decimal representation of the number a. 

The rational and irrational numbers are called real numbers. 

It follows that every nonzero real number is representable as an infinite 
decimal of type (1). If it is rational its decimal representation is a repeating 
infinite decimal. If otherwise, then, according to the definition stated, expression 
(7) itself specifies an irrational number. 

A nonzero decimal fraction can be finite but, according to the convention 
expressed by equality (6), it does not represent a new rational number since 
it can be replaced by a periodic infinite decimal equal to it. 

A number a for which not all e, are equal to zero is called positive or negative 
depending on whether (T) involves the sign “+” or “—”. As usual, the sign 
“4+” can be omitted. 

At present we only have a formal definition of a real number. It now re- 
mains to define the arithmetical operations on them, to introduce the relation 
expressed by the symbol “=>” and to check that the relation “>” is coherent 
with the corresponding operations and the relation “>” already known for 
rational numbers and also to verify that the ordinary conditions imposed 
on numbers are satisfied. 

The definition of the relation “>” is given in $ 2.2 and the arithmetical 
operations are defined in § 2.3. In § 2.4 we state and prove the basic prop- 
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erties of real numbers. These properties are divided into five groups 1-V. 
The first three groups include the well-known properties which are usually 
used when we perform arithmetical calculations and solve inequalities. 
Group IV consists of one property (the so-called Archimedean property). 
Finally, Group V also contains only one property expressed by the so-called 
principle of continuity for real numbers. For our further aims it suffices to 
know that the real numbers (the decimals) are objects for which the relation 
“>” and also the arithmetical operations are defined and that conditions 
1-V are satisfied for them. Therefore there is an alternative way of studying 
the book in which the material given in normal type is read carefully and 
systematically while the material given in small print (the proofs of Properties 
I-V) may be omitted or looked through. 

From Properties I-V all the other properties of real numbers can be derived 


logically. 
There is also an axiomatic approach to the definition of real numbers in 
which by numbers are meant some (abstract) objects a, b, c, ... satisfying 


conditions l-V. In this approach Properties 1-V are understood as axioms of 
real numbers. 

At first sight an axiomatic construction of real numbers may seem simpler. 
But in this connection there arises the question as to whether Axioms I-V 
are consistent. To prove their consistency it is necessary to construct some 
formal symbols for which it is possible to define the arithmetical operations 
and the relation “>?” and to check that they satisfy Axioms I-V. It turns out 
that the infinite decimals can be chosen as such symbols. 


8 2.2. Definition of Inequality 


Let us take two numbers a = tx. «œz... and b = tfo. fips... repre- 
sented by infinite decimals. They will be considered equal if and only if they 
are of one sign and 


a, = Bx (k = 0,1,2,...) 


By definition, a < b or, which is the same, b > a, if zo < fo or if there is 
an index (a nonnegative integer) / such that a, = f, (k = 0,1,2, ...,) 
and j+ < fias. 

Further, we write, by definition, a > O or a < 0 depending on whether 
a is positive or negative; we write a < b ifa < O and b > O or ifa, b <0 
and |a| > |b|. 

If a =+%.a@102..., then, by definition, —a = «oe. x1x»..., and the 
absolute value |a| of a is 4-xo. %1%2... = %.a@1%2. Thus, 


a for a = 0 
l-a] = lal =| 


—a for a «0 
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§ 2.3. Definition of Arithmetical Operations 


Suppose that there is a law according to which with every index (nonne- 
gative integer) n a number x, is associated. The collection of these numbers 


Xo, X1, Xo, ... (1) 


is called a (number) sequence. A sequence is said to be nondecreasing (non- 
increasing) if xy = Xy41 (Xr > Nn+1) for all k = 0, 1,2, .... 
We say that sequence (Y) is bounded above (by a number M) if there exists 
an integer M such that xy = M for all k = 0,1,2, .... 
If the numbers x; in sequence (1) are integers and if there is an integer 
£ such that x, = & for all k > ko we say that the given sequence is stabilized. 
It is obvious that if a sequence of integers is nondecreasing and bounded 
above by a number M it is stabilized, the corresponding integer E satisfying 
the inequality £ = M. 
Let us consider a sequence of decimals (which are all either finite or 
infinite) 
äi = Xio Xii X19 Hg... 
Gg = X29. X» Hag Gay... (2) 
G3 = X39. %31 @32 A33... 
The right members of (2) form a table (an infinite matrix). 
We shall say that sequence (2) is stabilized if there is a real number a = 
= Yo- Yaysya .-. Such that, for any k = 0, 1,2, ..., the kth column of table 


(2) regarded as a sequence of integers is stabilized, the corresponding integer 
being Yr (i.e. if tak = yx for sufficiently large n). In this case we shall write 


a, =a l 6) 


It turns out automatically that yo is a nonnegative integer while y, (k = 
= 1,2, ....) are decimal digits. en) 


Remark. The sequence of numbers Gy, ds Ay, . -. where 
dy =.1..0.. O11, 212, ...) 
à ` k times a 
and 
dgg41 = 0.9...911 eae (k = 0, 1, 2, ...) 
— — 
k times 


is not stabilized. From$ 3.1 where the notion of the limit will be introduced it will become 
clear that this sequence possesses the limit 1 (written a, — 1). We thus see that a sequence 
of decimals possessing a limit may not be stabilized. At the same time a, = a implies 
a, — a (see the example in $ 3.1). 


For an arbitrary number a = «o. €4x5 ... and an arbitrary natural n we 
now define the truncated number a(? = zo. 1 ... «, which is a finite decimal 
fraction. The reader is supposed to be familiar with the operations on finite 
decimals known from arithmetic. 
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Let us set two positive numbers a = a .a%1%2 ... and b = flo. fifls . . . re- 
presented as infinite decimals. 
Now we introduce the following sequence of numbers: 


amb) = xo... .On+ Bo. fi. A «Bn = Apa, ; Aw) (4) 
(n= 1,2,...) 
Below we shall prove a lemma implying that this sequence is stabilized, that 


is a+b“ = y where y = yo. Yıyz ... is a definite real number. It is 
natural to call this number the sum of the numbers a and b and write a+b = 


= Yo. Viy2---- . 
Thus, by the sum a+b is meant a number such that 
amb = a+b (5) 
The product ab, the difference a—b and the quotient a/b of two numbers 
a and b are defined as follows: 
(abm = ab (6) 
qi — (6) +107") = a—b (a > b > 0)* (7) 
and 


(eta) =F 8 


The expressions on the left-hand sides of (6), (7) and (8) do not decrease 
as n increases; by virtue of this fact and by the boundedness above of these 
expressions, it follows from the lemma proved below that they are stabilized, 
the corresponding numbers being denoted, respectively, as ab, a—b and 
a/b. It should be taken into account that a does not decrease as n increases 
indefinitely while b@)+10-" does not increase; besides, there hold the 
inequalities 


(ab) «s (xot 1) (Bo+1), a — (6410) = (ao-+1) 





IE (Cap 
(gece) BiU m cbs 


(where 5 is such that 8, > 0) showing that their left members are bounded 
above. 
Let us also put 


O0+a=at0=a and a0-0.a-a-a-i -0 (9) 
(a2 0, b> 0) 


* Here n > s where n, is so large that the difference on the left-hand side of (7) is 
positive. We also note that the equality (a— b)+b = a (a > b > 0) will be proved in 
§ 2.8 (after formula (4)) and that equality a- 1/a = 1 (a > 0) follows from § 2.8 (12). 
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We have defined for any two nonnegative numbers a and b their sum, 
difference, product and quotient under the assumption that in the case of 
the difference a = b and in the case of the quotient b > 0. Next, these 
definitions are extended in an ordinary way to any numbers a and b of 
arbitrary signs. For instance, if a, b = 0 we puta+b = b+a = — ([a|4-|bl). 
If a and b are of different signs we put a+b = b+a = +||a!—|b|| where 
the sign “+` or *— " should be chosen so that it coincides with the sign of 
the greatest, in its absolute value, number among a and b. In particular, 
we have 

a+(—a)=0 (10) 
for any a. 

Similar rules can be derived for the remaining arithmetical operations 
but we shall not dwell on this question since these rules are known to the 
reader from elementary mathematics. 


Now, to justify what was said we must prove the following lemma: 


Lemma 1. /f a nondecreasing sequence of type (2) is bounded above by an integer M 
it is necessarily stabilized, that is a, = a, where a is a number satisfying the inequalities 


a, ac M (a = 0,1,2,...) d1) 


Indeed, under the conditions of the lemma, the integers forming the zeroth column of 
matrix (2) are nondecreasing and bounded above by the number M. Therefore they arc 
stabilized, i.c. a, = yo for sufficiently large n, the corresponding integer y, satisfying the 
inequality 7, « M. Let us suppose that the columns of matrix (2) with indices not exceeding 
k arc stabilized, the corresponding integers Ye Yi», .. ., Ye being such that 


Yo Ya.e Yr M (where y,, .... 7, are decimal digits) (12) 


Let us prove that, under this assumption, the (k + 1)th column of (2) is also stabilized (i.c. 
Og 241 = Y1 l'or sufficiently large n), the corresponding integer 724 being a decimal digit 
such that the inequality 


Vo- Yi.. Maver © M. (13) 


holds. 
Indeed, the decimal representation of the number a, taken for n > n, where n, is 
sufficiently large is of the form 


Oy = Yor Yie - > Vha, etin ata... E M 


and, besides, a, does not decrease as n increases. Therefore, for the indicated values of n, 
the digits &, ++, (which do not exceed 9) do not decrease and hence they are stabilized, i.c. 
Aa, +1 = Yass for n = na where n. is sufficiently large and y, +, is a decimal digit. We also 
obviously have 


Yo: Yr- --Yaaa € Qm M (n > nj) 


Now we conclude, by induction, that inequality (13) and the relation a, = a = Yọ. 71)'s. .- 
hold, whence obviously follows the second inequality (11). Now it only remains to prove 
the first inequality (11). If we suppose that it does not hold there must be a natural n 
such that a — a,, which means that 


ln = Vor Yi- - Va, poen, r3 


for some k and y,,4 < Qn, 144. But this is impossible since the digit a, ., does not de- 
crease as 71 is given further increase and therefore it must be stabilized, which leads to the 
contradictory inequality 7.4.) < y441 for the corresponding decimal digit y, ,. 
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8 2.4. Basic Properties of Real Numbers 


I. Order Properties. 
I;. For every pair of real numbers a and b there holds one and only one 


of thc relations 
a=b,a>b and a<b 


L. a < band b <cimplya <¢ (the transitivity of the relation expressed 
by the symbol “~<”), 
Dy. If a -< b there exists a number c such that a < c < b. 


Properties 1, and 1, follow immediately from the definitions of the symbols “=" and 
“=”, lf two positive numbers a and b are represented as infinite decimals a = a,. ao... 
andh — £4. A.A... andit a < b, then, for some So, we have 


a- R; k æ s,— 1 tif sy = 0 these equalities should be deleted) 


and 
a,~ [OR 


There also exists s, > sọ such that f4, > O0. If we put e = aoai.. ani B... 
Buca - 1) 8,a... then, obviously, c is a number satisfying the inequalities 
a ~ c < b and c, > a. a,...2,,_, Ên- -Pa is a rational number satisfying similar in- 
equalities a ~ c, < b. 

We have thus proved I, for positive a and b. The extension of this proof to the case of 
arbitrary a and b is performed quite easily. 


II. Properties of the Operations of Addition and Subtraction’, 


Il. a+b = b+a (commutativity). 

Il. (a4- b)3-c = a+(b+c) (associativity). 
Il. a+0 =a. 

II. a4-(—a) = 0. 

IIs. a -< b implies that a--c -< b-+c for any c. 


It suffices to carry out the proofs of these properties for positive ‘numbers a, b and c 
since after that, as is known from arithinetic, they can be extended automatically to num- 
bers of any sign. Thus, let a, b, c > 0. 2 

1l; follows from § 2.3 (5) because it holds for tho finite decimals a+ 4/9 = b4 gio 
(a= 1,2,...2 i g DECREET ee P 

Properties IJ, and JI, immediately follow from the definitions stated above (see $ 2:3- 
(9) and (10)). since ha ME 

The Ei: of Il, see in § 2.8. Property II, is quite obvious in the casc when a and b are 
finite decimals, Now suppose that a and b are arbitrary, and let d’ and d” be finite decimals 


* When approaching the theory of real numbers axiomatically we must add the 
requirement that to each pair of numbers a, 5 there should correspond, in accordance 
with a certain lav. a number a+ b called their sum, and conditions II,-IT, should hold. 
Conditions II, and H, should then be modified to read: there exists a number 0 (zero) 
such that a-- O = afor all a, and for every a there exists a number — a such that a--(— a) = 
= 0. The uniqueness of the zero can be drawn logically from the axioms stated: if we 
suppose that there is another zero 0’ then 0’ = 0'+0 = 0+0 = 0. The axioms also 
imply the existence of the difference a— 6, that is of a number which must be added to 
b to obtain a. This number is a+ (— b) since a+(-—b)+h = a+0 = a. It is determined 
uniquely because if b+c = bte then e = (bbc (-b) +640 = c. 
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such that a < d' < d" -- b; then, for sufficiently large n, we have 
a < d' < d'"- b'? and atc < qd' cim < d"e < prc 
It obviously follows that a+c <d’te < d”+e< b+c,ie. ate < bcc. 
Equality Il, becomes trivial when a or b is equal to zero (see § 2.3 (9)). 


IN. Properties of the Operations of Multiplication and Division’. 


Ilf. ab = ba (commutativity). 
HIE. ab(c) = a(bc) (associativity). 
II. a-l — a. 


HL. at =| (a= 0). 


Is. (a--b)c = ac+be  (distributivity). 
Ill. u < b, c > 0 implies ac < bc. 


The same argument as in the case of properties lI shows that it is sufficient Lo verily HI 
only for positive a, b and c (see $ 2.8). 


IV. Archimedean Property. 


Given any number c > 0, there exists a natural number 1 > c. 

Indeed, if c = «o.«1x2» ... we can put n = «o2. 

The Archimedean property and some of the preceding properties imply 
that, given any positive number e, there always is a natural number 7 such 
that the inequality | /z < e is fulfilled. 

Indeed, according to IV, for the number 1/2 there is a natural number n 
such that I/e < n, which, by Illo, implies the required inequality. 

Note that for every given number c = 0 there is a single number m in 
the sequence 0, 1, 2, ... of nonnegative integers for which the inequalities 
m=<e<m-+l1 hold. 


V. Continuity Property of Real Numbers. 


Let there be given a sequence of closed intervals (i.e. of sets of numbers 
x for which a, = x = b,) 


On = [an ba] (n= 1,2,...) 


A system of such intervals is said to be nested if 6,41 C o, (n = 1,2, ...) 


* [n the axiomatic approach we should add the following: to every pair a, b there 
corresponds, in accordance with a certain law, a number ab called the product of a and b, 
and properties III,-IIl, hold. It is also necessary to modify III; and II, to read: there 
exists a number | (unity) different from 0 and such that a-1 = a for all a; for any a + 0 
there is a number l/a such that a- 1/a = 1. The uniqueness of 1 can be drawn logically 
from the axioms stated, together with the existence and uniqueness of the quotient 
a/b (6 = 0) which is a number by which b must be multiplied to obtain a. The derivation 
is completely analogous to that in the footnote concerning II: the only difference is that O 
should be replaced by | and the operation of addition by the multiplication. Then it 
turns out, automatically, that 1 > 0. Indeed, if we suppose that 1 < OthenO = 14-(— 1) « 
< — ] (see If, and I1;) and 1(— 1) < O(— 1) (see Ille), that is — 1 < O (see III), whence 
follows a contradiction: — 1 < 0 « — 1. It should be taken into account that 


0-(— 1) = 0-(- 1)+0-14+0-1 = 0-(— 14141) = 0-(0£21) 2 0-15 0 
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and the lengths of the intervals tend to zero”: 
d, = b,— a, - 0 (n > om) 


Then there is exactly one point (number) which simultaneously belongs 
to all the closed intervals o,,. 


Let us prove this property. First suppose that a, >= 0. Obviously, a, = do = ..e € bn 
for any m, which shows that the numbers a, do not decrease and are bounded above by 
any number b,, with arbitrary index m. Therefore, by Lemma 1, § 2.3, there is a number 
c such that a, = c, that is the sequence of numbers a, is stabilized. Furthermore, a, = c << 
< b- Since n and m in these inequalities are arbitrary we have, in particular, 


a, << c « D, (w= 1,2,...) 


and consequently c € c, for any a. 

Let us show that c is the onlv point possessing the indicated property. Suppose that 
there is another point c, of that kind. Then we have the inequalities a, « c and c, = 5, 
whence 5,— a, = |e4— cl = & > 0 for any n, which contradicts the condition 5,— «, -- 0. 

Now we take the case a, = 0. Putting, = a, la, and Pa = batla Q1 — 1,2, ...) 
we conclude, on the basis of what has been proved above, that there exists a single point y 
belonging to all intervals [«,, ,7,], which means that e = y- |a] isa single point belonging 
simultaneously to all intervals [a,, 5,]. 

Property V has thus been proved. 


Property V is spoken of as the nested interval theorem. In § 2.6 we shall 
show that this property can be replaced by some other properties equivalent 
to it (on condition that all the remaining properties hold). In the axiomatic 
approach to the theory of real numbers IV and V are naturally stated as 
axioms. 

It should be noted that if o, are open intervals of the type (dn, ba) property 
V may not hold in the general case. For instance, the intervals (0, 1/r), 
n= 1,2,..., form à nested family and their lengths tend to zero as n 
increases indefinitely but at the same time a point (number) which belongs 
to all of them does not exist. 

Indeed, zero and any negative number do not belong to any of the inter- 
vals. If a > 0 is an arbitrary positive number we can find, using the Archi- 
medean property, a natural number mo such that l/mo <a, and conse- 
quently the interval (0, 1/7) does not contain a for n > no. 


8 2.5. Supremum and Infimum of a Set 


A set E of real numbers x is said to be bounded if there is a positive number 
M such that the inequality |x| < M is fulfilled for all x € E or, which is the 
same, if — M < x < M for all x c E. 

If E does not satisfy this requirement, that is if for any positive number 
M, however large, there is xo € E such that | xo| > M, the set E is said to be 
unbounded. 





. *" Á sequence of numbers x, is said to tend to zero (synonymously, the values entering 
into the sequence are said to tend to zero) if, given an arbitrary positive number e, there 
is N > O such that | x, | < e forall n > N. 
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A set E is said to be bounded above (below) if there is a number K (k) 
such that x = K (k = x) for all x € E. The number K (k) is called an upper 
bound (a lower bound) of the set E. 

It is evident that a bounded set is both bounded above and bounded below. 
The set R of all real numbers is obviously unbounded and has neither upper 
nor lower bound; the set R. of all positive numbers is bounded below but 
is not bounded above; a closed interval [a, b] and an open interval (a, b) 
are examples of bounded sets (for finite a and b). 

A number M (m) is called the least upper bound or supremum (the greatest 
lower bound or infimum) of a set A of numbers if the following conditions 
hold: 

(i) x << M (x c= m) forall x € A. 

(ii) Given any € > 0, however small, there is a number xo € A such that 
M—e < xo (xo < m4 &). 

For the supremum of A we use the notation 


M = sup A = supx 
xEA 


and for the infimum we write 


m = inf A = inf x 
x€A 


("sup" and *inf" are, respectively, the abbreviations of the Latin supremum 
“the greatest" and infimum “the lowest"). In the next section we shall prove 
that every set bounded above possesses the supremum and every set bounded 
below possesses the infimum. It is quite obvious that the supremum and the 
infimum, provided they exist, are determined uniquely. 
For an unbounded set A having no upper bound we shall write 
sup A = supx = +œ 


xEA 
and for a set A having no lower bound 


inf A = inf x =— æ 
x€A4 


In these cases we shall say that + œ and — ce are, respectively, the supre- 
mum and the infimum of A. 

The supremum of a closed interval [a, b] or of an open interval (a, b) is 
obviously the point (number) b. In the case of a closed interval the supremum 
(the number 5) belongs to it while in the case of an open interval it does 
not. The supremum of the set (— œ, 0) is obviously the number O while its 
infimum is understood as the symbol — œ. 

We also note the obvious equality 

inf x 2 —sup (—x) 
x€4À x€A 
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§ 2.6. Other Statements of Property V 


Property V can be expressed equivalently in one of the following forms: 

V'. Any nonempty set WM of real numbers bounded above (below) by a 
number M (m) possesses the supremum (the infimum) c = M (c = m). 

V". If the set R of ail real numbers is divided into two nonempty disjoint 
sets, that is 


R= A+B, ANB=O (Oisan empty set) 


so that every a £ A is less than every b € B, then either there exists a number 
c which is the greatest among the numbers belonging to A, and then B has 
no least number, or there exists a number c which is the least among the 
numbers belonging to B, and then A has no greatest number. 


Let us prove that properties V, V' and V" are equivalent (provided that all the other 
properties hold). 

Let V hold and let W be a set of numbers Eounded above by a number M. If Misa 
finite set the existence of its supremum is obvious: it is simply equal to the greatest of the 
numbers belonging to M. Therefore we suppose that 9X is an infinite set. Let us denote by 
a, (ay = M) one of the points of M and take the closed interval o, = [ag, M]. Next. 
dividing vy into two equal closed subintervals we choose one of them containing points 
of the set M on condition that if both subintervals contain points belonging to W we take 
the rightmost of them. Let this subinterval be denoted as o, = [ai, b1]. Now we divide 
g, into two equal subintervals and denote by o, = [as, ba) the rightmost of these subinter- 
vals containing points of W. Proceeding in this way we obtain, by induction, the nested 
family of closed intervals 


g, = [an bn] (a= 1,2,...) 


whose lengths tend to zero. Every such closed interval contains at least one point belonging 
to M and there are no points of M to the right of it. By V, there is a point c belonging to 
all o,. Let x be an arbitrary point belonging to M. Then x = c because, if we suppose 
that c -< x, then there exists n such that x lies to the right of o, since 5,— a, -- O (i — co), 
which is impossible. On the other hand, for any point c, = c there is n such that c, lies 
to the left of v,, and in o, there is a point x, € M. Consequently c, -= xy. We have thus 
proved that Yt has the supremum which is the point c. 
The fact that a set bounded below possesses the infimum is proved in a similar way. 

Hence, V implies V'. 

Now suppose that V’ holds and that the set R of all real: numbers is divided into two 
classes (sets) A and B as described in V”. 

Let b be a point belonging to B. Then, by V", we have a < bforalla € A, and therefore, 
by virtue of F^, there exists the supremum of A: 


sup ac (1) 
ata 
and a = ¢ = b [orany a € A and b € B. By condition V" the number c itself belongs to 
one of the classes A and B. 1f c € A then, obviously, c is the greatest number in the set A. 
Let us suppose that B also contains the least number which we denote by ba. Then for 
the arithmetic mean of the numbers c and b, we have 


(c by)J2 = d < by 


and therefore d € A (since bg is the least number in the set B). On the other hand, c « d 
and, by (1), the number d cannot belong to A, and we thus arrive at a contradiction. 

, Now, if we suppose that c € B an analogous argument shows that c is the least number 
in the class Band then 4 has no greatest number. Hence we have proved that V’ implies V^. 
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Finally, suppose that V” holds and let v, = [a,, b,] be closed intervals with 5,— 2, -- 0 
forming a nested family. Let us divide R into two classes by means of the following 
construction: the class A consists of the numbers x each of which satisfies the inequality 
x — a, for at least one n while B consists of all the other real numbers which we denote 
by y. The set A is nonempty since, for instance, it contains the number a, — 1. The set B is 
also nonempty because, for example, any number 5, belongs to it. Now we take two 
arbitrary points x € A and y € B. By definition, y = a,, for any #, and for the given 
x there is 2 = n; such that x -< a. Therefore x < an, « y and x - y. 

We have shown that the sets A and B thus constructed satisfy the conditions of V”. 
Hence, according to V", there is a number c which is either the greatest number in A or 
the least number in B. But the set ÆA cannot have the greatest number because if x € A 
then, for some 7, the inequality x = ana, holds, and consequently the number x’ = (x+ a,)/2 
exceeds x and at the same time belongs to A. Thus, c is the least of the numbers belonging 
to the set B. But then a, «c = b, forany n = 1,2, .. 

Our argument shows thal there exists a number c belonging lo all«,. The uniqueness 
of c is quite apparent. 

We have proved thc implications V — V’ — V” — V, that is V. V' and V" are equiva- 
lent. The construction of the division of R into two sects described in V" is known asa 
Dedekind* cut. 


Remark. The rational numbers possess properties I-IV but Property 
V' does not hold for them. For instance, consider the set e of all rational 


numbers x less than a given irrational number a = xo. Zœ», .... The 
reader can easily prove that sup x = a, and thus the supremum of a set of 
x€e 


rational numbers may not be a rational number. 


§ 2.7. Isomorphism of Various Representations 
of Real Numbers. Length of an Interval. 
Physical Quantities 


In the foregoing sections the real numbers a, b, c, ... were defined as 
infinite decimals and it was shown that they possess the properties enumer- 
ated in Groups I-V (which will be briefly referred to as Properties I-V). 

Arguing in the same manner we-can define the real numbers as infinite 
binary or ternary fractions or, generally, use an arbitrary number system 
with base » to construct the corresponding symbols a’, b’, c', .. . representing 
the real numbers. The relation “>” and the operations of addition “+” 
and multiplication “-” can be introduced by analogy with the above, and 
the verification shows that these new objects satisfy Properties I-V as well. 

It should also be noted that the Dedekind cuts of the set of all rational 
numbers can also be used as a basis for the construction of the real numbers 
(e.g. see P. S. Alexandrov, A. N. Kolmogorov, An Introduction to the 
Theory of Functions of a Real Variable, GTTI, 1938 and G. M. Fikhtengolts, 
A Course of Differential and Integral Calculus, Vol. I, “Nauka”, 1970 (in 
Russian)). 

All the possible Dedekind cuts a’, b', c', ... are nothing but the divisions 
of the set of rational numbers into two nonempty sets (classes) 1l and 35 


* J, W. R. Dedekind (1831-1916), a German mathematician. In an axiomatic approach 
property V is termed the Dedekind cut postulate. 
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such that any number belonging to the set ll is less than any number belong- 
ing to the set $. It turns out that it is possible to define the relation “>” 
and the operations “+” and “-” for the Dedekind cuts and to show that 
they possess Properties I-V. 

Finally, the theory of real numbers can also be constructed by defining 
a real number as a Cauchy (fundamental) sequence of rational numbers. 
In the construction, sequences of this kind essentially different (in a certain 
sense) from each other are denoted by symbols a’, b’, c', ... For these 
symbols the notions “>”, “+” and “-” are then introduced after which 
it is shown that they possess Properties I-V (e.g. see V. V. Nemytsky, M. I. 
Sludskaya, A. N. Cherkasov, 4 Course of Mathematical Analvsis, Vol. 1, 
Fizmatgiz, 1957, in Russian). 

All the indicated methods of defining real numbers do not differ from each 
other from the formal, logical point of view. This follows from the theorem 
below which can be called a theorem on the isomorphism of the sets satisfying 
Conditions 1-V. 

The notion of an isomorphism or, more precisely, of an isomorphism with 
respect to the notions “>”, “+”, *." and “sup” (supremum) will be clarified 
below in the course of the statement of the theorem. 


Theorem. Let E be a set of decimal fractions a, b, c, ... and E' be a set of 
some elements a’, b', c', ... for which the relation "greater than" (“>”) 
and the operations of addition (“+ 7) and multiplication (* -'") are defined so 
that Conditions 1-V are fulfilled. 

Then it is possible to set up a one-to-one correspondence 


ana 


between the elements a € E and a' € E' which is an isomorphism with respect 
to the relation “>”, the arithmetical operations and the operation of taking 
supremum. 

This means that if 
uis a- a^ and b-b' 


then 
ELA. oed. atb ~ a’'+b’ 
ab ~ a'b' 
(1) 
a a 
Boe (b = 0) 
and if a <b then a' < b'. 
Finally, if E is'a set of decimals a bounded above and E' is the set of the 
corresponding elements a' then 
sup a~ sup a’ (2) 
acE a' EE’ 
This theorem says that, irrespective of whether we operate on decimal 
fractions a, b, c, ... or on the corresponding elements a‘, b’, c’, ..., if 
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these operations reduce to a finite number of arithmetical operations or to 
the determination of a supremum, the results of thc operations are always 
a certain number d and a certain element d’, respectively, which are in the 
relation d ~ d' indicated above. 

As will be seen later, we can also include into thc formulation of the the- 
orem the operation of passing to a limit. 

Hence all the concrete sets defined above (i.e. the sets of the Dedekind 
cuts, fundamental sequences, infinite binary fractions, etc.) are isomorphic 
to each other in the indicated sense. 

What has been said indicates that, as was explained at the end of $ 2.1, 
the theory of real numbers admits of a correct logical construction on the 
basis of an abstract axiomatic approach. 

Yt also indicates that from the formal point of view the definitions of real 
numbers as decimal fractions and as certain symbols satisfying the axioms 
are equivalent. The latter approach is of course preferable from the philo- 
sophical point of view since numbers are abstract notions expressing quan- 
titative relations observed in reality while decimal fractions are their formal 
representing symbols. 


We shall describe the basic stages of the proof of the isomorphism theorem. 

Let £ denote the set of all real numbers and £' a set of some other objects, different 
from numbers in the general case, satisfying Axioms I-V. 

Then £’ contains a zero element 0’ and a unity 1’ (0' < 1^), and the elements 2’= 1'—-l', 


3' = +l, ... and - l', —2’, —3', ... make sense. As a result we obtain a "two-way" 
sequence? of (pairwise different) elements of E': 

. -2, -150,1,2*,... (3 
These elements correspond to the integers 

.-2, -L0,,2,... 


Elements (3) can be divided by each other with the exception of the division by 0’. 
Therefore E' contains (rational) elements of the form -Ep'//g' = E n'p'[n'g' = a’ (q! > 0, 
p’ = 0) which are in a one- to-one correspondence with the rational numbers +p/q = a, 
which we write briefly as a ~ a’. Here n’ corresponds to the natural number n. This 
correspondence is an isomorphism with respect to the symbol “=: and the arithmetical 
operations, that is relation (1) is fulfilled (at present only for the rational elements). 

But this isomorphism a ~ a’ can be in fact extended to all the elements of the sets E 
and £*. Let us prove this. By the isomorphism between the rational elements established 
above, we have the correspondence 


Eagar... Hy ~ EAA nn 0, — (Oey... o) 107 


between the (inite decimals formed in £ and E’ where in the parentheses on the right-hand 
side stands the integer «x, ... &, = @)10"+a,10""14- ... +æ,- This correspondence 
is isomorphic with respect to the symbol “=>” and with respect to the arithmetical opera- 
tions. Let a = a,.a,a, ... bean arbitrary positive number represented by the corre- 
sponding decimal. It is readily seen that it is the supremum of the set of all the truncated 


* Numbers a, depending on the integral index & arranged as 
< Aaa, Lg Ags An Ae... 


are said to form a two-way sequence. 
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numbers a: a = sup a“. Since a™ = a,4- 1 for any n = 1,2,... wealso have a” < 


n 
e (oS - 1)’, which shows that the set of the elements a" (n = 1,2, ...) is bounded above. 
and consequently among the elements of E' there is an element «’ serving as the supremum 
d = supa, 


n 
It is natural to write a’ as the expression a’ = «g. aja, ... and to cali it an infinite 
decimal in E' while the elements a’ can be called the corresponding truncated elements. 
This construction assigns to each real number a an clement a’ € E (a — a’). This corre- 
spondence is coherent with the correspondence æg. &; ... Gp ~ @.% ... a^. because, 
together with the equality 


Qo. €... Uy = 09.04 ... 04 41 (447 0)99 ... 
we have the equality 
Ag Ai... G5 = 0,0... 4 (0,— 1) 99... (4) 


Indeed, by definition, the infinite decimal on the right-hand side of (4) is the supremum 
set of the corresponding truncated elements, and it is readily seen that the element 
ag. a; ... a also serves as this supremum, and therefore they must coincide because a set 
can only have one supremum. 

Now let us choose a positive element 2 € E’. According to the Archimedean property, 
there is a natural element 2’ > A. Thus, O<A = n, and, since 0’ << l’, we have 0’ =< 1’-<... 
... < W, In this finite sequence there is obviously a single (integral nonnegative) element 
c, such that a, < A = (a+ 1Y. Testing, in succession, the clements of the finite sequence 


ag = (ao. 1)' « (ay. 2) = ... -= (x0. 9Y -« («9-1 
we find a unique element (a. «,)' such that 
(Gy. @)' < 2 m (agp 10) 

(if a, = 9 then a. (a,+1) = o+ 1). Proceeding in this way we obtain. by induction, a 
sequence of digits @,,a.,@ 3, ..., such that 

(To. Oe... Oey < A (ao. 84... Oey (+ 1))’ (5) 
for any k = 1, 2, ... It cannot happen that for some natural / we have œ, = O for all 
k => l. Indeed, if we suppose that this is so, the element 2 satisfies the inequalities 

(15.0, ... Q) « A < (85.0, ... a, + (1075 (A = E13, I2,...) 

which indicate that it is a single element belonging to all the closed iniervals forming a 
nested family whose lengths tend to zero as k + co: 

AE laoai... m), (ao a... œ) + (1075) 
But the element (ap. @, ... &;) is sure to belong to all these closed intervals and therefore 
A = (ao. a ... &j)'; we thus arrive at a contradiction to the first inequality (5). 


Inequalities (5) imply that if a = a. ¢,@_... (here we mean by a a number represented 
by an infinite decimal) then 


A-a- sup (d?) = sup (a. a, ... a4) 
J k 


In what follows we consider infinite decimal representations of numbers without 
stipulating that they are infinite. 
If 0 < a < b then there are natural k and / such that a < 5? < 6 and therefore 
0< a < bP < band O < a < bY < K for any natural n, and consequently, 


0 < a = sup (ay « b < supb™ = 6’ 
thatisO < g < b'. 
We have thus proved (by now for positive a and a’ only) that the correspondence 
a ~ d is an isomorphism with respect to the symbol “>”. In particular, we have shown 
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that to different positive a there correspond different positive a’. Thus, the correspondence 
a — a’ is in fact a one-to-one correspondence a = a’ (also written a ~ a’) between the 
positive elements of E and E’ 

Now we shall prove that for positive a and b there holds the relation (a-- bY = a’ +b’. 
In the case when a and b arc finite decimals this equality is sure to hold. Let 


= my... b = Po. BBs... and atb =. Yiye... 


where the representation of a+b is, as we know, the result of the stabilization of a” +b. 
Therefore for any natural # there is a natural /> n such that (a+b) e a? - bo 
and (a+ by « (dP - p(0y = at 4+ 5O* < a' +b. But then 


(a by = sup (a+b) e a' +b’ (6) 
On the other hand, a < a! -- (10)7* and b < b(?--(10)^", and consequently 
d xod (107ny, b = b .-(107ny 
and 
a-b - a 4. p9' .- 20107 9)' = (at? + bly’ 4 2(107 y 
But there exists a natural s > n such that a’ bo — (aq-- by** ~< (a-E by’, and thus 
d +b < (at by -2(077) 


for any natural ». Hence, a' +b = (a-- b)', and taking into account (6) we obtain 


(a+by = a tb (7) 
In the same manner we prove for positive a and b the equalities 
(a—- by = a’-b’ (a> b) (8) 
and 
(aby = a'b', (4) = (9) 
For negative numbers a we put a’ = —(—a)’. Asa result, we obtain, together with the 


correspondence 0 ~ 0’, a one-to-one correspondence a ~ a’ between the real numbers 
and all the elements of £’. It is obviously isomorphic with respect to the symbol “>” and 
also with respect to the arithmetical operations. We shall limit ourselves to the proof of 
equality (7) for the case when a > 0, b < O and a > |b| without presenting all the details ` 
of the argument justifying the last assertion. 

In the case under consideration we have 


(ab = (a-|bD' = a’ [by = ab 


The first of these equalities holds by virtue of the well-known properties of numbers, the 
second equality follows from (8) and the third one is implied by the fact that a’—|6’| is an 
element of E' such that its addition to|5|’ results in a’. This (uniquely determined) element 
isequal to a 4- (—15|') = a'--(—(—b)') = a' - b' (see the footnote concerning Il in $ 2.4). 

Let us discuss in more detail the representation of real numbers by means of the points 
of a straight line which is an extremely convenient and commonly used method of repre- 
senting numbers. 

The considerations below are not quite rigorous from the point of view of formal 
logic; they rather describe a scheme which can be followed to construct a rigorous theory. 

Let us consider all the possible line segments belonging to various straight lines lying 
in a given plane. Among them we choose an arbitrary line segment which will be said to 
have unit length. Congruent line segments possess a common property which we shall 
denote by the letter a (or b, c, ...) and call the /engrh of any of the congruent segments. 
Let v and ô be respectively line segments of lengths a and b. If, when these segments are 
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that one of them, say o, is a proper part of ô, that is if 


applied to cach other, it turns oul Ja does not coincide with ô, we say that their lengths 


it turns out that ø is a part of ó an 


Eae E Ud de i cd from the unit segment by dividing the latter into g equal parts 
ánd aking ihe Montiel sum p of such parts is said to be rational or commensurable 
with unit measure, : i ci 
It is clear that the lengths of the line segments satisfy Axioms I. . 
By definition, the sum a-- b and the difference a— b (a > b) are respectively the lengths 
d etrical difference of the given line segments. ]t is 


Panic eom i 
ae case dr ea E we exclude If, and IT,) are satisfied for the lengths. 





Fig. 2.1 Fig. 2.2 


In Fig. 2.1 we see an arbitrary angle on one of whose sides line segments OA and AC of 
lengths 1 and b respectively are set off from the vertex while on the other side a line segment 
OB of length a is set off. We also draw through the point C the line CD parallel to AJ. ft 
cuts the other side of the angle at D; the length of the segment BD will be called, by delini- 
tion, the product ab. This definition is properly stated (i.e. it is not contradictory) because 
if we made the same construction for another angle O’ (Fig. 2.2) the resultant line segment 
B'D' would be congruent to BD. 

` ‘Now it becomes clear how a/b (the result of the division of a by b) should be defined. 

We lay off, in succession, from the vertex of an angle (sce Fig. 2.3) line segments of 
lengths b and a on one side and the unit segment on the other side and also draw the line 
CD purallel to AB. Then, by definition, the length of AC is a/b. This detinition is also 
properly stated, and the operation of division thus defined turns out to be inverse with 
respect to the multiplication: b(a/b) — a. 

It can readily be verified geometrically that Axioms III are satisfied for the lengths. For 
instance, the distributive law III, can be verified with the aid of Fig. 2.4. The relation 
(a—b)e = ac— bc (a > b) is verified similarly. 

Now let us take a straight line with a chosen initial point O. We have a one-to-one 
Correspondence between the points of this line lying to the right of O and the lengths of 
the line segments joining these points to the point O. These lengths will be called positive. 
Now we introduce formally a negative length — a corresponding to the point of the line 
symmetric to a with respect to the origin O (i.e. symmetric to the point corresponding to 
the length a). To the point O we purely formally assign the number zero (0). This results 
in a one-to-one correspondence between all the points of the line and the new symbols 
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c — (a+b)c — 





Fig. 2.3 Fig. 2.4 


a, b, ... which can now be positive or negative or zero. Following the ordinary rules 
which we shall not enumerate here we can define for the new symbols the arithmeticai 
operations and the symbol “>”. As is proved in elementary algebra, they satisfy Axioms 
I-11] because the positive symbols a, b, ... satisfy them. On the number line thus construct- 
ed we can (mentally) mark the rational points +p/q corresponding to the positive and 
negative lengths commensurable with the chosen unit measure. They themselves satisfy 
Axioms I-II. 

Axioms IV-V are also satisfied for the new objects. Axiom V expresses mathernatically 
the fact that we think of a straight line as a continuous geometrical entity. 

Thus, the lengths of the line segments supplied with the signs *-+ " and *—" (as was 
indicated above) satisfy Axioms I-V and hence their set is isomorphic to the set of real 
numbers. This allows us to identify, in practice, the notion of the length of a line segment 
and the notion of the number corresponding to this segment in accordance with the indic- 
ated isomorphism. 

In conclusion we note that physics gives us many examples of notions isomorphic to 
real numbers; they are called physical quantitics. Temperature, mass and also velocity 
of motion, when it is directed along a definite line, are all examples of physical quantities. 
]t can of course turn out that they are isomorphic not to all real numbers but only to 
those belonging to an interval. For instance, in the casc of the mass such an interval is 
(0, =œ). 


§ 2.8. Supplement 


In this section we present the proofs (sometimes the schemes of the proofs) of some 
of the assertions stated in $ 2.4. Perhaps it would be easier for the reader to understand 
them after he has studied the next Chapter 3. This does not mean that $ 2.8 is based on the 
material of Chapter 3; simply, the questions considered in these sections of the book 
involve analogous ideas but the representation of the subject-matter in § 2.8 is rather con- 
cise. 

A nondecreasing sequence of numbers 


ay = Aaa), |. a) 


will be called essentially nondecreasing if for any n, there is n > ng such that a4, = a,. 
There hold the following properties: zi 
(i) If a, is an essentially nondecreasing sequence and a, = a (= denotes the stabiliza- 
tion) w/tere a is a decimal fraction 
A = My, Oy... (2) 
the latter is infinite. 
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For if we had a = a, &,...«,00 ... then there would exist sa such that a, = 
= 06.0... Gn a.. m Bo: a@,...0,00... (n — ng). But this would only be possible 
if we had 0- e = at, =... for any n, and then sequence (1) could not be essentially 
decreasing. 

(ii) Le! two infinite fractions a = @. «3X4 ... and b = Bo- Bibe ... be such that the 
equality 
b? = As 4, (3) 


holds for any n where a” and b'? are the truncated fractions corresponding to a and b and 
À, tends to zero as n — «o. Then the decimal fractions a and b coincide and, consequently, 
a, = Br k = 0,1,2,... 

Indeed, if, for instance, we had a < b then for some k there would be 


A = 0,3.0,... X, 46,6... ... and — = yy ye iau... (B, > «,) 
and, besides, 9, > 0 for some s > k. Then for n > s we would have 
b a = do. Q1.. aae Puy By o One. mta mm 
= do Qi.. riper.. D, Mg. Ci.. Ari (X 3-1) 9 B, 1077 (B, > 0) 


lor any 4 > s. But this is impossible since, by the hypothesis, we have 5? — ah? = 2, + 0. 
Now let us prove that if a > b > Othen 


(a—b)+-b = a (4) 


Suppose that a and b are represented as infinite decimals: a = a4. œ... and b = By. ,. 
By definition (see § 2.3 (7)), a— b is a fraction obtained as the result of the stabilization: 


a'9— (b? 4. |07*) = a—b (a > b) (5) 
Therefore for each 5 there is s > n such that 
(a— bye = [d?— (6+ 10-7]? = AO — pos. y, 


where, obviously, 7, - 0 (n — œ). Note that the sequence of numbers on the left-hand 
side of (5) is essentially nondecreasing and hence, by property (i) proved above, the 
fraction a— 5 in (5) obtained by stabilization is infinite. The number (a— b)+b is, by defi- 
nition, such that (a= b)®+b@ = d®+y, = (a—b)+b. But wc have d? = a and 
7,.— 0; consequently, by property (ii), equality (4) does in fact hold. 

Let us show that 


(ab) c = a (b. c) (6) 
Indeed, wc have the obvious relations 
a + poo +. cO. ce (a+ by $l ce Qh. Hl + 107» 4. c0 
and 
A+ pi p CM cz AM + (5+ 0) em gt 4 H+ cM 107^ 
They show that the numbers (a-- b)? +c and a+ (b+c)™ differ from each other by 
a quantity A, not exceeding, in its absolute value, the number (10)^" and thus tending to 


zero as n + «o, Therefore, by virtue of (ii), relation (6) holds. 
A quantity of the type of A, (A, — O for n + <œ) is also denoted as 


o(t) (1n + 29) () 


It should be noted that if, together with 4,, we deal with some other quantities of this 
kind (called infinitesimals) they are also denoted by the same symbol (7). 


20006-5 
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Properties III,-III, are immediate consequences of the following equalities: 


(apio = (bq yo (8) 
(Cab) c9»). = (ab) -++0(1) = Abc + 0(1) (n = co) (9) 
(abe) = aM +-9(1) (n + co) (10) 
(a. (1) = a +0(1) (n =œ) (11) 
(G^ a9)" = (4) «on = eet toll) =J+o(1) — (2) 
(atb = (a+b) -- o(1) = are. 6%" 4 o(1) (13) 

and 
(acy + (bc) = ae 4- bc + o(1) (n + œ) (14) 


Property (8) is obvious. As an example, we shall elucidate the proof of property (9). 
The first equality in (9) holds because the removal of the outer subscript (1) leads to an 
increase of the first term in (9) by a quantity (by a finite decimal fraction) not exceeding 
10-* = o(1). 

Furthermore, ab is a number such that 


(ai? Py = ab 
Therefore for any n there is s > n dependent on n such that 
(ab = (PHD = (a+ p.) (B9 4- vO = {AHO (ar + BM pe, + ay )ym = 
= (a b+ o(1) = (AMM) 4 9(1) = OH + 9(1) (n — œ) 
(where 4, = o(1) and v, = o(1), n = œ). In the third equality it should be taken into 
account that a! « a and b™ «x b, and therefore ar, = o(1) and bu, = o(1) and 
also that o(1)3-o(1) = o(1). By virtue of the above-proved relation (2), from (9)-(14) 
follow, respectively, III,-IH,. The verification of the fact that the operations on infinite 
fractions are coherent with the corresponding operations on rational fractions is left to the 
reader. 
For instance, in the case of addition it is necessary to check that the decimal represen- 
tation 
Pi Pz LAMPS 
q g: qid» 


of the sum exactly coincides with the sum of the infinite decimal representations of the 
summands. 


8 2.9. Inequalities for Absolute Values 
The inequality 


jal < £ (1) 
is equivalent to the two inequalities 

—e<a<e (1°) 
Hence the inequality 

la-b| < e (2) 


is equivalent to the inequalities 
b-e<a<bte (2^) 
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Analogously, the inequality 
ja—bl «s (3) 
is equivalent to the inequalities b-esa<b+e. 
There also hold the inequalities 
lab] = Ja|4- [5] (4) 
and 
ja—b] > llal — ibli (5) 


Inequality (4) can be derived by considering separately the four possible 
cases: (i) a, b = 0, (ii) a, b = 0, (iii) a = 0 = b and (iv) b = 0 «a. 
For instance, in Case (ii) we have 


a+b<b<0 and |a4b| — —(atb) - —a—b = Ja|4-]b| 
while in Case (iii), assuming that |b| = |a], we obtain 
la+b] = b+a «Ja|-4- Ibl 


Let the reader consider Case (iii) by analogy with Case (i) under the 
assumption |b| = |a|. Case (iv) is reducible to (ui). 
Further, by (4) we have 


jaj=|b|+|a—b| and |b| <fa[+fa—b| 
that is 
ja|—ja—b| = |b| =|aj+|a—b| 


whence follows (5). 


CHAPTER 3 


Limit of Sequence 


§ 3.1. Concept of Limit of Sequence 


The method of limits is the basic method lying in the foundation of mathe- 
matical analysis. 

Suppose that there is a certain law of correspondence which assigns to 
every natural number n = 1,2, ... a number x,.* Then we say that there is 
defined a sequence of numbers x1, X2, Xs, . . . of, briefly, a sequence {xn}. 

The numbers x, entering into a sequence {x,} are called its elements. They 
can be real or complex. Here we shall consider the case of real sequences. 

Below are examples of sequences: 


© {a} = {1,2,3,...}, 

o («ti 

(iii) {om} = {-1,5,-4...-}, 
(iv) E = (o3...) 

(v) (i = (1.1; 101; 1.001; ...), 
(vi) (—0" = (7L +1, -1, ...), 

(vii) (1; 2; ...; 10; 0.1; 0.01; 0.001; ...}. 


In Case (vii) we cannot write a single general formula for an arbitrary 
element x, but the law according to which the numbers x, are formed is 
clear: 


n for n = 1, ...,10 
Xa = 1 
" d) for n — li, 12, mm 
* Thus, x, is a function defined on the set of natural numbers. 
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When dealing with a sequence {x,} we shall call x, a variable and say 
that the variable x, runs through the sequence {x,} or that it runs through the 
sequence of values X,,. 

A variable x, whose all values are equal to one and the same number a is 
called a constant and is usually simply denoted as a. 

By definition, a number a is called the limit of a sequence {xn} if, given any 
arbitrary positive number e, there is a natural number N (dependent on €) 
such that the inequality 


(x, — a] -€ (n >N) 


holds for all natural n > N. 
If a is the limit of (x,) we write 
lim x, = lim x, =a 


A=» œ 
or 
Xn >a 


and say that the variable x, tends to a or that the sequence {x,} converges to 
the number a. 

Let us show that the variable in Example (ji) has a limit equal to zero. 
Indeed, setting an arbitrary € we write the inequality 


Ix =+<e 
H n 


which obviously holds for all n > Land hence for all n > N where N is an 


arbitrary natural number exceeding 1, N> 4 . Thus, for any c > O there is 


a natural number N such that |x,| < e for alln > N. 

In exactly the same manner we can prove that the sequence in Example 
(iii) has zero limit. The variable in Example (iv) tends to 1 because in this 
case 

n—1| l 
| — xal sji- =l<e 
for all x > N where N is any natural number greater than 1/e. 

It can readily be shown that the variable in Example (v) tends to 1. The 
variable in Example (vii) obviously tends to zero. The fact that the values 
of the elements of the sequence in Example (vii) first increase does not 
affect its convergence to zero: for the convergence only its values corres- 
ponding to sufficiently large n are essential. 

If x, satisfies the inequality 


la — Xn] < € 
this is equivalent to the fact that it satisfies the inequalities 
a—E < Xr < ate 
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or, geometrically, to the fact that the point (number) x,, belongs to the inter- 
val (a— e, a+ e). Therefore we can restate the definition of a limit in geometri- 
cal terms: a variable x,, has as its limit a number (point) a if, given any € > 0, 
there is a natural N such that x, € (a— £, a+ £) for all n > N. 

An arbitrary interval (c, d) containing a point a, or, equivalently, such 
that c < a < d, is called a neighbourhood of the point a. It is obvious that 
for an arbitrary neighbourhood (c, d) of a there is € > Osuch that the interval 
(a— &, a+ £) is contained in (c, d), that is (a— e, a-- €) c (c, d). 

Therefore the fact that x,, + a can also be expressed as follows: given an 
arbitrary neighbourhood (c, d) of the point a, all the points x,, beginning 
with some value of the index n, are in that neighbourhood, that is there 
must exist a natural N such that x, € (c, d) for n > N. As to the points 
Xj ..., XN with the indices n = N, they may or may not belong to (c, d). 
Hence, if there are some points x, lying outside (c, d) their number is finite. 

On the other hand, if it is known that there are only a finite number of 
points Xm» Xs. ..., Xn, lying outside (c, d) we can put 


N = max (n,ns, ..., ms} 


and then x, € (c, d) for all n > N. Thus, the definition of limit can also be 
stated as follows: a variable x, has as its limit a number a if the set of points 
x, lying outside any neighbourhood of the point a is either finite or empty. 

The variable in Example (vi) has no limit at all because if we suppose that 
it has a limit equal to a then any neighbourhood of the point a, however 
small in its length, contains all the elements x, with the exception of a finite 
number of x,. But it is clear that outside any interval of length 1/2, irres- 
pective of its position on the real line, there are an infinite number of ele- 
ments x, of the sequence in question, and hence the sequence has no limit. 

It is readily seen that the sequence in Example (i) does not tend to any. 
limit either. In what follows we shall say in such a case that the sequence 
has an infinite limit (tends to infinity); the meaning of this statement which, 
to some extent, is different from the above definition will be clarified later on. 

It is quite obvious that if a variable x, has a limit this limit is determined 
uniquely. For if x, possessed two different limits a and b (for definiteness, let 
a « b) then each of the intervals (a— e, a+) and (b— e, b+e) where 
e = (b—a)/3 would contain all the points of the sequence {xn} except 
possibly a finite number of them. But this is obviously impossible because 
these intervals have no points in common (do not intersect). 

Example (vi) shows that there can occur equal numbers among the ele- 
ments of a sequence {x,} having different indices n; and m»: Xm = Xn, 
But even in this case x, and x,, should be regarded as different elements of 
the sequence. 

It is clear that if two sequences {xn} and {xn} have only a finite number of 
different elements with the same indices n they simultaneously either have no 
limits or converge to equal limits. 

We shall prove a number of theorems describing some properties of the 
variables possessing limits. 
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Theorem 1. If a variable x, has a limit then x, is bounded. 
Proof. Let x, > a. Then for € = 1 there is a natural number N such that 


1 > |x,—a| forn >N 
It follows that 1 > |x,—a| = [x,|— |a], that is 
[xal = lal+1 forn > N 
Let us put M = max (Ja]-- 1, [xil, ..., |xw!}. Then, obviously, 
ixa «M (n=1,2,...) 
that is the variable x, is bounded. 


Theorem 2. If a variable x, has a nonzero limit a there is N such that 


Ixul > 42b forn >= N 
Moreover, for these n, if a — 0 then X, > a[2 and ifa « 0 then x, < a[2. 
Thus, beginning with some value of the index n, the variable x, is of the same 
sign as a. 


Proof. Let x, — a. Then for € = |a|/2 there exists a natural N such that 
Jh -ja-x|bm-ia-b-| >N) 


whence |x,| > [al -dal = n, and the first assertion of the theorem has 


thus been proved. On the other hand, the inequality |a|/2 > |a— x, | is equi- 
valent to the two inequalities 


lal lal 


a——- < Xa < at (n > N) 


2 
and therefore if a — 0 then 
$sa-Mex, (n > N) 
and if a < O then 
x, «ac =a-f = (n > N) 


which completes the proof of the second assertion of the theorem. 


Theorem 3. If x, — a, y, — b and x, <y, for all n= 1,2, ... then 
a=b. 


Proof. Suppose that b < a. Let us set a number € <2 and find 
natural numbers N, and N2 such that 
a~e<Xx, (n>N) and y,<b+e (n> No) 


This is possible since x, — a and y, > b. 
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Putting N = max (Ni, No} we obviously obtain y, < b+e <a—e < x, 
for n > N, and thus we arrive at a contradiction because, by the hypothesis, 
Na = Yn for all n. 


Theorem 4. 7f variables x, and y, tend to one and the same limit a and if x, = 
= Zp = yu (n = 1,2, ...) the variable z, also tends to a. 
Proof. Given ¢ > 0, there are Ny and Ne such that 


a—e- x, (n>N) and ypy<ate (n> No) 
and therefore, for n > N = max {Nj, No} we have 


— € - X, SEn m y, SAFE 
whence 
|Z,-a| < € (n > N) 


which is what we set out to prove. 


Theorem 5. 7f x, — a then | xn| > iaj. 
Proof. The assertion of the theorem follows from the inequality 


li xe! —|aij <= [xa — | 


8 3.2. Arithmetical Operations on Limits 


Let x, and y, be variables which respectively run through two sequences 
{x,} and {yn}. The sum x,+yn, the difference x,— Ym the product x,y, and the 
quotient x,/y, of x, and y, are defined as variables running respectively 
through the sequences (x,-4- Va}, (x«—y«). (x«y») and {x,/y,}. In the case of 
quotient it is supposed that y, z 0 for all n = 1,2, ... 

If x, = c for n = 1,2, ... we write c+y,, cy, and c[y, instead of x,+y,, 


XnYn and x,[y,. 
There hold the following assertions: 
lim (Xn Eyn) = lim x, lim y, (1) 
lim (Xaya) = lim x, lim y, (2) 
. x, 0 dim x, 3 RUM : 
lim T cm if limy, #0 (3) 


These assertions should be understood in the sense that if x, and y, possess 
limits then the limits of their sum, difference, product and quotieat also exist 
(in the latter case under the assumption that lim y, # 0) and equalities (1)-(3) 
hold. 

Proof. Let x, -+ a and y, — b. Setting an arbitrary e > O we choose N 
such that 

ix, — a] <> and |y,—){ -3 (n > N) 
Then 
IG xy) - (atb) = Ix,—alkiv—b] 4-6 (n>) 
and we have thus proved (1). 
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To prove (2) note that 
| xay, — ab! = | Xayn — ay,-F ay, — ab| zx | Xay» — aynl + lay, — ab | = 
= »lix,—a|-lally«— b] (4) 


Since y, has a limit (by Theorem 1 proved in the foregoing section) there 
exists a positive number M such that 


liM  (n=1,2,...) (5) 
We can choose M so that the inequality 
ia| < M (6) 
also holds. Let us take a natural N such that 
ixa) eag and ph eai (n> N) (7) 
Then it follows from (4)-(7) that 


This proves equality (2). 
Let us add (to the conditions x, ~ « and y, — b) the supplementary 
condition b = 0. Then 





| nj a Xab- Yna) FON iQ, - a) b- yal 1x,— al A6— lal 8 

X bii xb i1 ly, 1151 TUE U psi (8) 

Now we can use Theorem 2 of the foregoing section according to which 
|b 

bm (n>N) (9) 


for sufficiently large Ni. Setting an arbitrary € > O we choose Nz and N3 
such that 


elbi 
[x,— al] < 


(n > Nə) (10) 
and 


lally,— bl <È (n>N) (11) 


Finally, putting N = max (N;, N2, Ns} we obtain, by virtue of (8)-(11), the 
inequalities 





+5 <8 (n > N) 


whence follows equality (3). 

It should be noted that the limits of the variables on the left-hand sides 
of equalities (1)-(3) may exist even when the limit of x, or the limit of y, 
(or both) does not exist. For instance, if x, = y, = n then x, and y, have 
no (finite) limits while lim (x, -- y,) = 0 and lim x,/y,, = 1. 
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The theorems on the limits of sums, differences, products and quotients 
make it possible to find out in many cases whether a given variable has a 
limit and what this limit is provided that this variable is the result of a 
finite number of arithmetical operations on some other variables the exist- 
ence of whose limits is established and the values of the limits are known. 

But there are also many cases when the above theorems are inapplicable. 
To find such limits a mathematician should apply some other methods. 


§ 3.3. Infinitesimals and Infinities 


A variable «, possessing zero limit is called an infinitely small quantity 
(magnitude) or, simply, an infinitesimal. 

Thus, a variable x, is an infinitesimal if, given any € > O, there is N such 
that |o, | = £ for n > N. It is obvious that for a variable x, to have a number a 
as its limit it is necessary and sufficient that x, = a4+-a, where x, is an infi- 
nitesimal. 

A variable P, is called an infinitely large quantity (magnitude) or, simply, 
an infinity, if for any M > O there is N such that | B,] > M for n > N. For 
an infinitely large variable f, we write 


lim n = œ or Bn ce () 


and say that /3,, tends to infinity. This terminology proves convenient although 
the symbol «e does not denote any number, and an infinitely large variable 
does not tend to any finite limit ( number). 

If, beginning with some n = N, an infinity fa assumes only positive 
values or only negative values we write, respectively, 


lim f, =+ œ (equivalently, B, -- + e») (2) 
Or 
lim B, = — e (equivalently, B, — — œ) (3) 


We sec that from (2) (and also from (3)) follows (1). The example of the 
variable ((— D") shows that it may happen that relation (1) holds while 
neither (2) nor (3) holds. 

We state the following obvious properties: 

1. If a variable x, is bounded while y, is infinitely large then x,[y, > O. 

2. If the absolute value of x, is bounded below by a positive number and y, 
is an infinitesimal such that y, z 0 then x,[yg — œ. 

We shall confine ourselves to the proof of the second property. 

By the hypothesis, there is a number a > Osuch that the inequality | x,| > a 
holds for n = 1,2, .. ., and, given any € > 0, there is N such that 


Db =e (n>N) (4) 
Then 


- (n>N) 





sis 
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"A 


Taking an arbitrary positive number M we can choose ¢ such that M = aje 
and then find, for the given e, a natural N so that Property (4) holds. Then 
‘x, 


pit | > M (n> N) 


| Mn 


which is what we intended to prove. . 
The above two assertions imply corollaries 


lim 5 — 0 and lim—=2 (ez 0) 


Sameera UA Yao ÁR 


h 
Let a =» 0 and let & be a natural number. By Va we shall mean, unless 
the contrary is stated", the arithmetic Ath root of a, that is a nonnegative 
number whose kth power is equal to a. Such a number exists and is unique. 
It will be more convenient to prove this assertion later (at the end of § 4.5) 
but we shall use it now. This is a way in which roots are treated in elementary 
mathematics: their propertiesare proved without justifying their existence’’. 


Examples 


. k . DD AL. 
l. lim Yn =œ (k = 1, 2, 3...) because the inequalities y7 = N and 


N= 


n > N* (where N > 0) imply each other, and therefore, given any N, there 
is no (namely, any no > N*) such that yn > N for all n > no. 


2. At the same time, we have lim V n = 1. Indeed, Yn = 1+¢,, where e, > 
>0. Hence***, n= (] 4- ey! > A &; therefore £} < -4 and (see Exam- 
ple 1) & < V2//n—1 — 0 (n> œ). 

3. For a > 1 and natural k we have lim (n*/a") = 0 since if we put a = 


n c 


= l+e then e > 0 and, for n > k, we can write 


w _ f E wo (kc! nt Á 
a^  (l-6) ` Chttettt 458 g(n-1)...(n-K) — 
_ (E D! 1 l 


~0  (n—e) 


* If k > 2 then among the values of the kth root of a there are complex values. 

** Here are meant the properties enumerated at the beginning of § 4.6 (including cela- 
tion (1)). : 

*** Here we have used Newton's binomial formula. It is usually derived in elementary 
mathernatical course. The derivation of the formula based on the notion of the derivative 
of x^ is presented in § 5.9. 
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§ 3.4. Existence of Limit of Monotone Bounded Sequence 


Not every variable has a limit. It often happens that it is necessary to 
find out whether a given variable possesses a limit. The theorem below pro- 
vides a simple existence criterion for the limit of a variable. 


Theorem 1. Let a variable x,, n = 1, 2, ..., be nondecreasing (nonincreas- 
ing), that is let x, satisfy the condition x, = Xn+1(Xn = Xn41) for any n = 
= 1,2,... Jf it is bounded above (below) by a number B (A) there exists a 
limit lim x, equal to a number M (m) satisfying the inequality M « B(A « m). If 
the variable is not bounded above (below) then lim x, = + œ (lim x, 2 — œ). 

Proof. We shall present the proof for the case of a nondecreasing variable. 
In the case of a nonincreasing variable the proof is quite analogous. 

Let a variable x, be nondecreasing and bounded above by a number B. 
Then, as is known, there exists the supremum sup x, = M = B. 


Li 
Therefore x, « M (n = 1, 2, ...) and, given any £ = 0, there is n = no 
such that 
ME < Xm 
Since the variaole x, is nondecreasing we have 
Nitg UE Nn 
for all n — na. Consequently 
M-e < xs M-« Mte for n > ne 
that is 
jx,-M| ee for n > no 
which means that x, has a limit equal to M: 
lim x, = M 
Now suppose that a nondecreasing variable x, is not bounded above. 


Then, given an arbitrary positive number M, however large, there is x,, such 
that M < X». Since x, is nondecreasing we have 


Xm = Xn for n > ma 
Hence, for any positive number M there exists N = no such that 
M «x, forn > N 


which means that lim x, =+ œ. 
Nondecreasing and nonincreasing sequences are both called monotone 
sequences. 


Example 1. The variable q” (n = 1,2, ...) where 0 <q <1 satisfies 
the condition q7*! < g^, which means that it is monotone decreasing. It is 
bounded below because 0 « q" for any n. Consequently, by Theorem 1 it 
has a limit lim q" = A. 


n= o: 
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Obviously, q"** must have the same limit 4; hence 
lim q"^** = q lim g" = qA and A=qd 
Since q = 1 this can only be the case when A = 0. Thus 
lim gq" = 0 (0 <q <)}) 
jie ts 


It follows that 


lim a^ — lim 


noo H— 0 (Ha) T 
for a> 1. 
Example 2. Let us show that lim = = 0. . 
By virtue of the equality |a"/n! | = |a|"/n!, it suffices to consider the case 


a > 0. Let m be a natural number such that m+1 > a. Then (see Example 1) 
gis A a J^-o ME 





n m! (ml 
Example 3. If a sequence a, = Yai yusyua ... (n = 1.2, 3, ...) of real 
numbers represented as infinite decimals is stabilized, i.e. a, = a where 
a = yo. yiyz... is a definite number, then a = lim a,. Indeed, given any 


e > 0, there is m such that 2-10-* < e, and for this m there is no such that 
An = Yo V1 - -- YmYn, m4 1Pa, m42 +--+ 
for n > no. Since the first m-+1 decimal digits of a and a, coincide we have 
Ja—a,| = (0.0 ... Ovme arte. - .— 0.0 ... OYn, meta mes j E 
= 10.0 ... Ova... {+]0.0 ... OYn, mei... 1s 
z107"4-107" < € 


§ 3.5. The Number e 
Let us consider the variable 


a(n) = (14 (0212,...) 


We have 
n(n—1) 1| 


poate = 


= 1445 (1-2) 3 (1-4) (1-4)+ -.. 


n n n 





a(n) = Inl 


and, similarly, 
e(n4-1) = 1143 (1 =) +37 (1 a) ( Aute 


"nil ET! ^ nii 


The terms in a(n) are less than the corresponding terms in a(7-- 1) and, 
besides, «(n+ 1) includes an extra positive term (the last one). Therefore 
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a(n) <a(n+1) (n = 1,2, ...) and thus the variable x(n) is monotone in- 
creasing. 
Furthermore, 


nn) = 224 (17) 3 (1-4) (1-2)+ m 


<2+5+at - belt tet + <2+1=3 


1 
Tar 
This means that the variable a(n) is bounded above. 
Consequently the variable «(7) is monotone increasing and bounded 
above. Hence, by Theorem 1, it possesses a limit which does not exceed 3. 
This limit is a definite number called the number e. Thus, 


E AH 
Jim (1 HA) =e (1) 
The number e plays an extremely important role in mathematics, which 
very soon will become clear to the reader. In a certain sense it is natural 
to choose it as the base of logarithms. This number is also called the Napier 
number after J. Napier (1550-1617), a Scotch mathematician. It is irrational. 
Here we write the number e to six correct decimal places: 


e — 2.118281 


In $ 5.10 we shall show how the number e can be evaluated with an ar- 
bitrary preassigned accuracy. 

After the notion of a limit of a function has been introduced we shall see 
that the above limit exists and is equal to e even when z tends to plus infinity 
and to minus infinity assuming continuously the corresponding real values. 


8 3.6. Cauchy's* Criterion for Existence of Limit 


Let a variable x, (n = 1,2, ...) tend to a finite limit a. Then given an 
arbitrary positive e, there is N such that 


Ix,—al <5 (n > N) 


Let n and ;n be any two natural numbers exceeding N. Then 


€ € 
|x,—a! <5 and  |x,—«| <5 (n,m > N) 
whence 
E 
[X,— Xu] = |Xn—- a a— xy| «1x,—a|4-]a— Xm 447 =E 


and we thus arrive at the following assertion: 


* A. L. Cauchy (1789-1857), a famous French mathematician. He was the first to 
state the definitions of the basic notions of mathematical analysis (limit, continuity, 
integral, etc.) in the way characteristic of modern mathematics. 
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If a variable x, (n = 1,2, ...) has a finite limit it satisfies the condition 
known as Cauchy's condition: for any £ > O there is N such that the inequality 


|Xn— Xm] < € 


is fulfilled for all n, m > N.* 

It turns out that the converse is also true: 

If a variable x, (n = 1,2, ...) satisfies Cauchy's condition it tends to a 
finite limit, that is there exists a number a such that 


lim x, = a 


We shall prove this proposition. Let there be given a variable x, (n = 
= 1,2, ...) satisfying Cauchy's condition. Let us put £ = 1 and find N 
such that 

|Xn—Xm| <1 (n, m > N) 


Fixing some m > N we obtain from the last inequality 
l> |Xn—Xm| = {Xnl—| Xml 
that is 
[Xn] = 14+] xm] (n > N) 


and hence the variable x,, is bounded. 

Now, for an arbitrary natural number n we define the following two 
numbers 

a = infx, and f„ =sup Xk 
k>n k>n 

They are respectively the supremum and the infimum of the numbers x, 
for k > n. We can also say that the numbers «, and f, are defined so that 
[£n Bn} is the smallest (in its length) closed interval containing the set of the 
numbers xy with k > n. The intervals [«,, 8,,] form a nested family: 


[Xn Bad > [Ons 1 Bus J 
because 


&,- infx,- inf Xg = anpi = fni = sup x, <supx, = f), 
kn k>n+1 ' k>n41 kzn 
It may turn out that œ, = f, for some n. Then the interval [«,, fn] degen- 
erates into a point but this does not affect the validity of our further argu- 
ment. l 
The length of the interval [«,, 8,] tends to zero as n +o and therefore 
Cauchy's condition implies that for any € > O there is no such that 


Xn E € Xk =€ Xn $e 
for all k > no whence 
Xy, E S Zm = Pug = Xp 6 





* A sequence satisfying Cauchy’s condition is called a Cauchy sequence or a fundamen- 
tal sequence. — Tr. 
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i.e. 
2€ = Bno Xn > Bun— an (n > no) 


According to the nested interval theorem, there is a point a belonging to 
all the intervals [x,, B,). Let us prove that a is the limit of x,. To this end, 
let us take an arbitrary interval (c, d) containing the point a. 

Since the lengths of the intervals [«,, 8,] tend to zero there is an interval 
[£n Bn] which is entirely contained in (c, d). 

It is obvious that for k > n we have xz € [£m Bu] < (c, d) which shows 
that 

a = lim x, 
hee o 

Combining the direct and the converse propositions we arrive at the 
following theorem expressing Cauchy's criterion for the existence of a ( finite) 
limit: 


Theorem. For a variable x, (n = 1,2, 3. .. .) to tend to a (finite) limit it is 
necessary and sufficient that it should satisfy Cauchy's condition. 

We also note that Cauchy's condition can be stated in the following alter- 
native form: for any £ > 0 there is N such that 


[Xu — Xn <E 


Jor all n > N and any natural p. 


§ 3.7. Subsequences. Limit Superior and Limit Inferior 


Consider an arbitrary sequence {x,} = (xi, xs, xs, ...} consisting of real 
numbers. We can choose in infinitely many ways a new sequence consisting 
of some elements of the given sequence: 


{Xu} = Qs. Xn Xup -> .} 


Here the index ng runs through an increasing (infinite!) sequence of natural 
numbers nı < n2 < n .... The sequence (x,,) is termed a subsequence of 
the original sequence (x,). m i 

We shall only be interested in subsequences which converge to finite 
numbers or to + e» or to — œ (that is have finite limits or infinite limits of 
the type of +. or — œ). All the sequences (and subsequences) of this 
kind will be referred to as convergent sequences and their limits will be con- 
ditionally called numbers (finite or infinite). This convention extends the 
term “number” to the symbols — œ and + œ. If « is an arbitrary (finite) 
number we usually write — œ — x <+ œ. Under the above convention 
+ œ can be regarded as the greatest number and — «o as the least number. 
It is obvious that for the set of numbers thus extended all the axioms of real 
numbers forming Group I (see $ 2.4) hold. 

It should be stressed (this is extremely important for our further argu- 
ment) that the elements x, (but not the numbers x,!) of a sequence {x,} 
are regarded as different if they are supplied by different indices n. Thus, 
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one should distinguish between the numbers (points) corresponding to the 
values through which the general element of a sequence runs and the ele- 
ments of the sequence themselves. 

For instance, the sequence 


1,2,3,1,2,3,1, ... (1) 


(like any other sequence) consists of an infinite number of elements xi, x», 
Xa, ... but its general element x, runs through a set consisting of only three 
numbers (points) 1, 2 and 3. 

It is evident that if a sequence is convergent its every subsequence is also 
convergent to the same number (finite or equal to + c» or to — e»). But ifa 
given sequence (x,) has a convergent subsequence this does not imply that 
the given sequence is itself convergent. 

At the same time there holds an important theorem often called the 
Weierstrass* theorem which we state and prove below. 


Theorem 1. Every bounded sequence {xn} contains a convergent subsequence 
{Xm} whose limit is a finite number. 

Proof Let the values x, of the sequence in question belong to a closed 
interval o = [c, d]. Dividing this interval into two equal parts we can take 
the rightmost of these parts containing an infinite number of elements x, 
(let it be denoted as 41). 

This means that if both parts contain an infinitude of elements then A, 
is the rightmost of them and if only one of these parts contains an infinite 
number of elements x, then 4, denotes that very part. 

Let x», be one of the elements belonging to the interval 4. Dividing the 
interval 4, into two equal parts we denote by 42 the rightmost of the parts 
containing an infinite number of elements x,. Among these elements there 
is obviously an element x,, with rn» > nı. Generally, if the closed intervals 
di > 425 ... D Ak-ı and the corresponding elements Xm» ..., Xn 
belonging to them have been already constructed we denote by A, the right- 
most of the halves of the interval A%—ı containing an infinitude of elements 
Xn. Among these elements there is obviously an element xn, with nę > nii. 
Let a be the point belonging to all 4, (k = 1,2, ...). The subsequence 
{Xa} which has thus been constructed is obviously convergent to a. 

The theorem has been proved. 

Now we state the following definition: a number a (finite or equal to + œ 
or to — ee) is called the limit superior (the limit inferior) of a sequence of 
real numbers {x,}, or, equivalently, of the variable x,, if there exists a sub- 
sequence {x,,} convergent to œ and if any other convergent subsequence of the 
sequence {x,} tends to a number which is not greater (not less) thana. 

For example, sequence (1) obviously has 3 as its limit superior and 1 as 
its limit inferior while the limit superior of the sequence 1, —2, 3, —4, ... 
is equal to + æ, its limit inferior being equal to — e. 


* K. I. W. Weierstrass (1815-1897), a noted German mathematician. 
20006— 6 


$2 A COURSE OF MATHEMATICAL ANALYSIS 


The limit superior and the limit inferior are respectively denoted as lim x,, 
and lim x, and also as 1 m sup Xn and lim inf x, (in connection with the 
second notation also see the exercise at the end of this section). 

A sequence {Xn} can have only one limit superior (limit inferior) because 
if we suppose that a, and a» are two such limits and a; < as then there must 
exist a subsequence bd, convergent to a» which contradicts the assumption 
that a; is the limit superior. 

It should be noted that the construction used in the proof of Theorem 1 
which is based on the nested interval theorem leads to a subsequence {x,,} 
convergent to a number a coinciding with the limit superior of the sequence 
{xn}: 

a = lim x, 


Indeed, suppose that a' — a. We can choose a natural n so large that a' 
lies to the right of n. The number of elements x, lying to the right of 4, 
can only be finite and consequently there cannot exist a subsequence of the 
sequence {Xa} convergent to a’. 

This construction thus proves the existence of the limit superior of a 
bounded sequence. 

If we changed this construction and, for every n, denoted by 4, not the 
rightmost but the leftmost of the halves of 4„—ı containing an infinite number 
of elements x, we should obtain a number (point) a equal to the limit in- 
ferior of the sequence (x). 

Next we shall show that the limit superior (the limit inferior) a of a bound- 
ed sequence {x,} possesses the following property: given an arbitrary € > 0, 
the interval (a— £, a+ £) contains an infinite number of elements x, and there 
are not more than a finite number of elements x, lying to the right ( to the left) 
of this interval. 

Indeed, there exists n such that 4, c (a— €, a+ £); since A, contains an 
infinite number of elements x, so does (a— e, a4- e). To the right (to the 
left) of 4, there are not more than a finite number of elements x, and there- 
fore the same applies to (a— £, a+ c). 

For a bounded sequence {xn} of real numbers this property i is s equivalent to 
the definition of the limit superior (of the limit inferior) stated above. 

Indeed, for definiteness, let us consider the case of the limit superior. 
If a is a number possessing the indicated property and a’ is another number 
exceeding a (a' > a) then choosing £ so that a < a+e < a' we see that 
there are not more than a finite number of elements x, to the right of a+ e. 
Consequently there cannot exist a subsequence of the sequence {x,} con- 
vergent to a'. At the same time there exists a subsequence of the sequence 


{xn} convergent to a. To obtain it we fix € > O and choose rm, so that 
Xm € (a~e, ate) after which we choose ns > m so that x,, € (a-7. 


a+), which is possible since the interval (a-+, a+) contains an in- 
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finite number of elements x,. Next we choose n; > nz so that Xn, € (a-3 


3 > 
€ 
at) , etc. 


If a sequence is not bounded above it is clear that it contains a subsequence 
convergent to + œ, and since + œ is greater than any number we have 


lim x, = + 


If a sequence is bounded above by a finite number (we denote it b) but is 
not bounded below the following two cases are possible: 

Case 1. There is a finite number a < b such that the inequalities a « x, <b 
are satisfied for an infinite number of values of the index n. If these values 
are arranged in an increasing order they form an infinite subsequence of 
natural numbers (nj) = (ni < n2 < ...}. To this subsequence corresponds 
the subsequence {x,,} of the original sequence which is obviously bounded. 
The existence of the limit superior of such a subsequence has already been 
proved. It is readily seen that 


lim x, = Jim Xn; 


n æ 


and we have thus proved that in Case 1 lim x, also exists. 

Case 2. For any finite a, inequality a = x, =b or, which is the same in 
this case, the inequality a = x, holds for a finite number of values of the 
index n. This obviously means that 


Jim x, = — œ 


But then for the limit superior (and also for the limit inferior!) we have 
lim x, = — œ, that is this limit exists in the latter case as well. 


Combining these results with the results concerning a bounded sequence 
established above we arrive at 


Theorem 2. Any sequence of real numbers {xn} has the limit superior (the 
limit inferior) equal to a finite number or to + œ or to — œ. 


If a sequence is bounded its limit superior and limit inferior are finite num- 
bers. 


There also holds 


Theorem 3. Every infinite sequence {xn} of real numbers contains a sub- 
Scquence convergent to a finite number or to + or to ~ œ. 

(If a sequence is bounded the limit of its every subsequence is a finite 
number.) 

Indeed, by Theorem 2, any sequence has the limit superior and hence 
there exists a subsequence {x,,} convergent to it. 


Theorem 4. The inequality \im Xn = Tim x, holds in all the cases; the 
equality sign appears in this relation if and only if there exists the limit (equal 
6* 
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to a finite number or to + or to — e) of the variable xn. Then 
lim x, = lim x, = lim x, (2) 
Indeed, if the limit of x, exists all the subsequences {x,} tend to it, which 
implies (2). Conversely, let -- 
lim x, = lim x, = A (3) 
If A is a finite number it follows from (3) that, given any e > 0, the in- 
equality 
A-€<X,< Ate 
is fulfilled for all the values of the index n except a finite number of them, 
which means that x, — A. If A =+ e» the inequality x, = M can only be 


satisfied by a finite number of elements x, for any finite M; then lim x, = 
=+ œ. The case A — — o is treated similarly. 


Theorem 5. If a sequence {xn} is such that its every subsequence contains a 
subsequence convergent to one and the same number A there exists the limit 
lim x, = A. 

Indeed, since any convergent subsequence {x,,} tends to A we have lim x,— 
= lim x, = A, and hence, by Theorem 4, the limit lim x, = A exists. 

We also note the following useful equality: 


For bounded variables x, and y, we can also write the inequalities 
lim (xz +n) = lim x,+lim y, (5) 
and 
lim (Xut Ya) = lim Xn + lim Yn (6) 


where xn and yn are bounded variables. 
Inequality (5) is proved as follows: there is a convergent subsequence 
{xa + Yn} Such that — — 
lim (Xa+ Yn) = lim (Xn, + Yn) (7) 


and it is possible to choose a subsequence {n,} of {n,} such that the limit 
lim x,; exists. Further, the subsequence (7;), in its turn, contains a sub- 
sequence (n;') such that the limit lim y,y exists, and therefore the limit 
lim x,y also exists. Consequently, 


lim (xz, + Yn) = lim (Xag Hyng) = lim xng +lim yg «lim x,+lim y, (8) 
From (7) and (8) follows (5). 


By (4) and (5), we have 
lim (x, + Ya) = —lim (—Xn-+(—Yn))  — (lim (—x,)+lim (—»,)) = 
= lim Xn+lim Ja 


that is (6) holds. 
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Example. Let us consider the sequence E = {sin na} (n = 1,2, ...). 
If & = Az where A = p[q is a rational number (p, q > 0) the values of the 
sequence are of a periodic character: 


sin æ, sin 2a, ..., sin 2ga, sinc, sin 2«, ... (9) 


The limits of its various convergent subsequences can only be equal to 


one of the first 27 numbers (9). The greatest of them is obviously lim sin ng 
while the least is lim sin ne. 

Now suppose that à > O is an irrational number. Let us mark the numbers 
na as arc lengths on the unit circle y, as is done in trigonometry. Then, for 
any different natural numbers nı and no, the points 71« and nex are, geomet- 
rically, different because, if otherwise, there would hold the equality 


nxx = nia +2kr (x = Az) 


where k is an integer, that is (n2—m)A = 2k, and A would be a rational 
number. Consequently the points na (n = 0, 1,2, ...) form an infinite set 
which we denote by W. Now it can readily be shown that, given any € > 0, 
there is a pair of points mia and mea such that the distance between them 
(measured along y) is less than c. This means that 


(no— ni)& = 2kz 4-0 = f (nı = n3) 


where |w| < £ and k is an integer. 

The points 0, 8, 28, 38, ... obviously belong to Mt. Furthermore, the 
distance between any two neighbouring points of this sequence is equal to 
one and the same constant number not exceeding e. It follows that for any 
point ¢ € y there is a point on y belonging to the set IN and lying at a distance 
(measured along y) less than £ from the former point. This shows that any 
point ¢ € y is a limit point* of the set M. 

What has been said implies that for any ¢ there is a subsequence of the 
sequence of natural numbers nı < ng < ng ... such that 


lim sin nj« = sin i 


k—> co 


But sin ¢ assumes all the values lying within the closed interval [—-1, +1] 
whence follows that 


lim sin næ =—1 and lim sinnx = 1 
n— oo n=» œ 
Exercise. Let the reader prove that for any variable x, there hold the 
relations 


lim x, = lim supx, and limx, = lim inf x; 


n-e kn No kn 


* The definition of a limit of a set is given in§ 3.8. As follows from this definition, a set 
possessing a limit point contains a sequence convergent to that point (which may not 
belong to the set). — Tr. 
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Hint. For a variable not bounded above (below) we have sup x, =+ œ 
kn 
inf x, =— =) and therefore it is allowable to write lim (+ œ) = + œ 
k>n 
(lim (—9)2-— ey 


n- o 


n— co 


§ 3.8. Weierstrass’ Theorem 


Let E bea set of numbers (of points of the real line). By definition, a point 
a is called a limit point (also an accumulation point) of E if its any neigh- 
bourhood, that is any interval (c, d) such that c < a < d, contains at least 
onc point x belonging to E and distinct from a. 

It is readily shown that every neighbourhood (c, d) of a limit point a of a 
set E does in fact contain an infinite number of points of the set E, and it is 
possible to choose from them an infinite sequence of different points xi, Xa, 
Xa, s. (Xn = Xy for n # k) convergent to a. Indeed, according to the defini- 
tion, (c, d) contains a point x, € E such that x4 # a. Now we can take an 
interval (ci, d) of length di—c; < 1 containing the point a and not con- 
taining x1. Again, according to the definition of the point a, there is a point 
belonging to the latter interval such that x» € E and x2 # a. Next we can 
find an interval (cs, d2) of length ds— c» < 1/2, containing the point a and 
not containing x; and x», in which there is a point x3 € E such that xy = a, 
etc. Ás a result, we obtain the required sequence. 

Thus, the definition of a limit point can be restated in the equivalent 
alternative form: a point a is a limit point of a set E if its any neighbourhood 
contains an infinitude of points belonging to E. 

The set £' of all limit points of the given set E is called its derived set. 


Example 1. The set E of the points of the sequence {1/7} has the point 0 
as its limit point. 

Indeed, any neighbourhood of the point 0 contains an infinite number of 
points belonging to the sequence in question. On the other hand, if a # 0 
the interval (a— £, a4- €) where 0 < e < |a} contains either a finite number 
of points of the set E or no points of E at all. Hence, the only limit point 
of the set E is the point 0. This point itself does not belong to £. 

We see that in this example the derived set E' consists of only one point 
0 not belonging to E. The set E, consisting of the point 0 and of the points of 
the form 1/n (n = 1,2, ...) obviously also has 0 as its limit point but in 
this case the latter belongs to E). Thus, a limit point of a set may or may 
not belong to that set. 


Example 2. The set R of all rational numbers has as its limit points all 
the points of the real axis, both rational and irrational, since any interval 
contains a point of R. The collection of all the limit points of the set of 
irrational points x satisfying the inequality O « x «1 is obviously the 
closed interval [0, 1]. 

A set A consisting of a finite number of points obviously cannot possess 
a limit point, that is in this case A’ is an empty set. An unbounded infinite 
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set may have no limit point cither; this is confirmed by the example of the 
set of natural numbers I, 2, 3, ... On the contrary, fora bounded infinite 
set there holds the following 


Weierstrass’ Theorem. Every bounded infinite set of points E has at least 
one limit point, that is in this case E' is a nonempty set. 

This theorem is proved in $ 7.9 (Theorem 2) for the general case of 5 
dimensions. But the reader may study this proof even now interpreting it 
for the one-dimensional case. 


8 3.9. Countable Sets. Countability of the Set 
of Rational Numbers. Uncountability of the Set 
of Real Numbers 


A set E of arbitrary elements x is said to be infinite if, given any natural 
number n, however large, there is a subset of E containing more than 5 
elements. 

A set E is called countable if it is infinite and if its elements can be numbered. 
This means that it is possible to set up a one-to-one correspondence between 
all the elements x € E and the natural numbers 


| r (1) 


If, under this correspondence, an element x € Æ is associated with a natural 
number n it appears natural to denote it x,. As a result, the elements of the 
set E can be arranged as a sequence 


E = (xy xs xs...) (2) 


In particular, set (1) of natural numbers is a trivial example of a countable 
set. It is obvious that the set of all even natura! numbers is also countable 
since it is infinite and its elements x can be numbered by putting x, = 2n 
(n= 1,2,...). 

Let E be a countable set and let its elements be numbered and arranged as 
a sequence of type (2). If A is a nonempty subset of E then it contains an ele- 
ment with the smallest number (index). Indeed, in (2) there is an element 
X», with number n = 7t;, belonging to A. There are only a finite number of 
clements x, € A with indices n = n; among them there is an element xj, 
with the smallest number which is obviously an element of A having the 
smallest number in comparison with all the other elements of A. 

If E is a countable set and A is its infinite subset then A is a countable ser 
whose elementis can be numbered as follows: we denote by zi the element of 
A having the smallest number in the set E, delete this element from A and 
take the element of the remaining infinite set 4; having the smallest number 
in £, this element being denoted by zs; then we delete z« from Au, ctc 

A countable (set-theoretic) sum ( union) of sets of the type 


E= (Joa ERE Le 


kal 
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where each set E* is countable is also a countable set. Indeed, let us arrange 
the elements x* € E* (j= 1,2, ...) as the table 


E= {x}, x3, xh a} 
FP = {x}, x, xb oe } 
B= {x4, ox xb] 


a 


Now we can number them in the following order: 
xi, xl, x2, xl, x8, xt; xl, ... 


Here at each stage of the numbering process we should delete those elements 
which have already been numbered at the foregoing stages; the matter is 
that E* and E! may have some common elements. This procedure results 
in an infinite sequence of elements {y3, y», Y3, . ..) which obviously exhausts 
the set E. This shows that E is a countable set. 

We can similarly prove that a finite sum E = EM ... +E of countable or 
finite sets among which there is at least one countable set is also countable. 

Let us prove that the set of all positive rational numbers and also the set 
of all negative rational numbers are countable sets; this means that the set 
of all rational numbers is also countable. 

There are no rational numbers p/q with q = 0 and q > 0 (p and q are 
integers) such that p--q = 1. There is exactly one number p/q with p--g = 2 
which is 1 = 1/1; let us denote it yj. Now among the positive rational 
numbers yet remaining not numbered there are two numbers p/q with 
p+q = 3 which are 1/2 and 2 = 2/1; let us denote them respectively as 
y» and ys. This process can be extended indefinitely by induction. As a 
result, all the positive rational numbers will be supplied with natural indices, 
which is what we intended to prove. 

On the other hand, the set of all real numbers is uncountable. 

To show this we shall prove that even the set of real numbers contained 
in the interval (0, !) is uncountable. This will obviously mean that the whole 
set of real numbers is uncountable as well since, as we know, a subset of a 
countable set can be either finite or countable (or empty). Let us write the 
points (numbers) x belonging to the interval (0, 1) as infinite decimals. 
Suppose that the interval (0, 1) (as a point set) is countable. Then all its 
points can be numbered: 


x! = Q.ololal... 
x2 = Q.odadat ... (3) 
x = O.adadad ... 


We shall show that this conclusion leads to a contradiction. Let us take, for 
every natural n, a decimal digit c, such that the inequalities œ, > 0 and 
Z, = x? hold, which is obviously possible. Now we construct the number 
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a = Q.a1x293. . .. It belongs to the interval (0, 1) and therefore must have a 
certain number ny in Table (3): a = x^». But then there must be Zn, = «72 
which is impossible. 


Exercises 


1. Prove that the set of points in the plane with rational coordinates 
(x, y) is countable. 

2. Prove the same assertion for the set of points (xi, ..., x») of the 
n-dimensional space of n-tuples having rational coordinates x;. 


CHAPTER 4 


Limit of Function 


§ 4.1. Concept of Limit of a Function 


A number 4 is called the /imit of a function f at a point a if the function 
is defined in a neighbourhood of the point a, that is on an interval (c, d), 
€ <a < d, except possibly at the point a itself, and if for any € > O there 
is ô > 0 (dependent on £) such that the inequality 


UG) 41 <e 


holds for all x satisfying the condition 0 < | x—a] = ô. 
The fact that A is the limit of fat a point a is symbolized as 
limf(x)= A or f(x)+A (x-a) 

An alternative definition of the limit of a function at a point can be stated. 
in terms of limits of sequences. 

A number 4 is called the limit of a function f at a point a if the function 
is defined in a neighbourhood of the point a, except possibly at the point a 
itself, and if the limit of the sequence {/(x,)} exists and is equal to 4 for 
any sequence {x,} convergent.to a such that x, # a for all n. Thus, 

lim f(x) =A l 


Xna 


Here, as in all similar cases, it is tacitly implied that the variable x, 
tending to a runs through a set of values for which f(x) is:defined. ` 

These two definitions are equivalent. Indeed, let a function f have a limit 
in the sense of the first definition and let there be a variable x,, whose values 
do not coincide with the number a for any n tending to a. Setting an arbitrary 
€ we can choose, according to the first definition, a number 6 such that 
f(x) A] = e for 0 < [x,—a| < 5. Since x, — a there is a natural number 
N such that | x, —a| < 6 for n > N; therefore we have 


A(x- A] «6 for n>N 


that is the sequence (/(x,)) converges to A. Since this property holds for 
every sequence {x,} tending to a and such that x, + a and all x, belong to 


90 
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the domain of definition of the function, we have thus proved that the first 
definition implies the second one. 

Conversely, let a function f(x) have a limit in the sense of the second 
definition. Suppose that it has no limit in the sense of the first definition. 
Then there exists at least one value of £, say € = £o, for which there is no 6 
mentioned in the first definition; this means that for any 6 there is a value 
x= x? belonging to the set of numbers x satisfying the condition 
0 < [x—a]| < ô such that | f(x) — 4| = £o. 

Let us consecutively take as 6 all the numbers 6, = 1/k (k = 1,2, ...). 
For each of them there is a point x, = x‘? such that 

1 


0<|x,-al< T (xk = a) 


and 
|f (xx) — Al = £o (k = 1,2, ...) 


These relations show that x; (x, # a) tends to a while f(x,) does not 
tend to the number A. Hence, the assumption that the second definition 
does not imply the first one leads to a contradiction. 

We have thus proved the equivalence of the two definitions. 

The expression "the limit of a function at a point a" is often replaced by 
"the limit of a function for x tending to a" or, briefly, "the limit ofa function 
as x — a”. The last two expressions are in a certain sense closer to the idea 
of the limit because the number A = lim f(x) has nothing in common with 


the value of f at the point x — a itself. Moreover, the function may not be 
defined at x = a. The number A provides some information on the behaviour 
of the function in a small neighbourhood of the point a from which this 
point is deleted. It says that when x assumes values different from a and 
approaches a according to an arbitrary law, the corresponding value f(x) 
approaches 4, that is becomes arbitrarily close to A. 


Example 1. Let us consider the function f(x)-— . It is defined 
for all x ~ 2. We shall find its limit as x-- 2. For di x Æ 2 we have 
ciini = x+2, and since the definition of the limit as x ^ 2 does not in- 
volve the value of the function fat the point x = 2, we obtain 











lim -* —. = lim (x2) 


xe? Vos x-2 
The meaning of this equality is that if one of the limits entering into it 
exists the other also exists and is equal to the former. Hence, instead of 
evaluating the limit ofa more complex function ~ = , it is sufficient te find 


the limit of the simpler function x+2 as x ~ 2. The latter limit is obviously 
equal to 4. Indeed, if we substitute any variable x, tending to 2 for x 
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into x+2 then, irrespective of the way in which x, tends to 2, we obtain 
lim (%,.+2) = 2+2 = 4 
x2 


The calculations connected with the evaluation of the given limit can be 
written in the Stau traditional form: 


= lim x+2 =4 





x-2 


It should be stressed that f(x) — * and p(x) = x+2 are different 


functions. The former is defined for x + 22 while the latter is defined for all x. 
But when evaluating the limit of the given function f(x) as x + 2 we are 
not interested in whether or not the function is defined at the point x — 2 
itself, and, since f(x) = g(x) for x + 2, we have 





lim f(x) = lim 9(x) = 9 (2) 
x-2 xd 
Example 2. It is evident that lim x? = 1 because if x, + 1 and x, ~ 1 
x-1l 


then 
lim x? = lim x, lim x, = 1:1 = 1 


On the other hand, this fact can also be proved by using the “e, ô language". 
Let us consider an interval containing the point 1, for instance (—1/2, 
3/2). For any x belonging to it we can write the obvious inequalities 


[5-11 = El x71] e 1x1] 
Now, taking an arbitrary £ > 0 and putting 6 = min {> 3b we ob- 
tain the relation 
52 
2. eg 
.qx8—1| = 2"g6—6 


for all x satisfying the inequality | x— I | < 5, which completes the proof. 


Example 3. The function sin (1/x) (its graph is shown in Fig. 4.1) is defined 
for all x = 0 and hence it is defined in any neighbourhood of the point 
x = 0 except at the point x = 0 itself. TuS function has no limit as x — 0 


because the sequence of values x, = zo EF k= 0,1,2, ..., which are 
different from zero, tends to zero while the values 
I(x) = (D 


do not tend to any limit as k + œ. 
Let us state the following definition. We shall write 


A = lim f(x) 


Xo 
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"j 


Fig. 4.1 


and say that 4 is the limit of the given function f(x) for x tending to infinity 
if f is defined for all x satisfying the inequality |x| = K with some K > 0 
and if for any € > 0 there is a number M > K such that |f(x)— A] < € 
for all x satisfying the inequality | x |-- M. 

It can be proved that this definition is equivalent to the following one: 

A number A is the limit of a function f(x) for x — æ if the function f(x) 
is defined for all x satisfying the condition |x| = M for some M and if 

lim f(x) = A 
XQ — 
for any sequence {x,} tending to œ. 

The proof of the equivalence of these two definitions is carried out ac- 
cording to the scheme used above in the case of the limit of fat a finite 
point a. 

Generally, many properties of limits of functions for x - a where a is 
a finite number and for x — œ are analogous. These properties admit of a 
unified presentation which simultaneously covers the cases when x > a 
where a is a finite number and when x — œ. To this end we shall agree to 
interpret the symbol a as any (finite*) number or «e. If a is a number then 
by a neighbourhood of the point a is meant any interval (c, d) containing 
the point a. Hence, a neighbourhood of a ( finite) point a is the set of all the 
points x satisfying the inequalities c < x < d. If a =œ (or a=+e or 
a — — œ) we shall agree to understand a neighbourhood of a as the set 
of all x satisfying the inequalities 


[x|>M (orx> Morx--—M) where M=>0 
We shall write 
lim f(x) = A 


* The symbols œ, +æ and — co are often called infinite numbers and then the ordi- 
nary numbers are termed finite numbers. 
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where a can be a finite number or œ (or + œ or — æ) if the function f(x) 
is defined in a neighbourhood of the point a except possibly at the point a 
itself* and if for any e > O there is a neighbourhood of the point a such that 
the inequality 

I&A] « € 


is fulfilled for all x belonging to this neighbourhood and different from a. 

The last definition of the limit of f unifies all the cases treated above, i.e. 
the cases when x tends to a finite number a and when x tends to « or + e 
Or — ©, 

Now we proceed to the study of the properties of a function f(x) having 
the limit as x — a where a is a (finite) number or œ or + œ or — e». Let us 
agree that an arbitrary neighbourhood of a will be denoted by the symbol 
U(a). It is readily checked that the intersection of two neighbourhoods U;(a) 
and U,(a) is again a neighbourhood U(a). 


Theorem 1. 7f lim f(x) = A where A is a finite number then the function 


x-aa 
f(x) is bounded in some neighbourhood U(a), that is there exists a positive 
number M such that 


GO] « M forall xe Ula), x#a 


Proof. The conditions of the theorem guarantee the existence of a neigh- 
bourhood U(a) such that 


121f/6)—-4|21/6)1-14] (x€ U(a)}, x a) 
Whence for the indicated values of x it follows that. 
IA] s 1-4-1AI 
where 14-] 4| plays the role of M. The theorem has been proved. 
Theorem 2. If lim nf (x) = A where A +£ 0 is a finite number then there is a 
neighbourhood U(a) ‘such that 
2 
o= (eUa, x » a) 
Moreover, for the indicated values of x we have 


fo)-— f 4-0 
and 


SOF f A<0 


* This stipulation is only necessary when a is a finite point (number). 
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Proof. It follows from the conditions of the theorem that there is a neigh- 
bourhood U(a) such that 


V. = A-S AIS (EE Ula), x za) 
which becomes quite clear if we denote £ = a Therefore for the indicated 
values of x we have |f(x)] > | 4|/2. The first of the above inequalities can 
be equivalently replaced by the inequalities 

A- I. s fo) < At fl 
It follows that for A > 0 we have 


A (Al - 
-=z = Aa x f(x) 


and for A < 0 we have 


A A 
f(x) A I LR 


which is what we had to prove. 


Theorem 3. 7f 
lim fi(x) = 4i and limfo(x) = Az 


and if there is a neighbourhood U(a) such that 
Ax) = f(x) 


for x € U(a) and x # a then A, = Az. 
Proof. Let x, > a, x, = a; then for sufficiently large no we.can write the 
inequality 


Shn) = fo(xn) (n > no) 
which, after the passage to the limit, results in 4; < 4». 
Theorem 4. If 


lim fi(x) = 4 and lim fo(x) = A (1) 
and if [ois g 
A « p « fix) Q) 
for the values of x belonging to a neighbourhood U(a), x # a, then 
lim g(x) = A (3) 


X-—uü 
Proof. Let x, — a and x, ~ a, then for n > no we have 


Ai) s P(Xn) s fiG) 
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if no is sufficiently large. By virtue of (1), it follows that the limit of q(x,) 
exists and is equal to A. Since {x,} is an arbitrary sequence convergent to a, 
condition (3) does in fact hold. 


Theorem 5 (Cauchy’s Criterion for Existence of Limit). For the (finite) 
limit lim f(x) to exist it is necessary and sufficient that the function f(x) be 


defined in a neighbourhood of a except possibly at the point a itself and that 
for any £ — O there exist a neighbourhood U(a) such that the inequality 


S-S e 


holds for any two points x‘ and x” belonging to U(a) and different from a, 
that is x', x" € U(a) and x', x" # a. 
Proof. Let lim f(x) = A where A is a finite number. Then there is a neigh- 


wa 
bourhood of a such that /(x) is defined throughout this neighbourhood with 
the possible exception of the point a itself. Furthermore, given any £ > 0, 
there is a neighbourhood U(a) such that if x € U(a), x # athen]f(x)— A| < 
< e[2. Let x’, x" € U(a) and let x’, x" = a; then 


Ife) fa) < Vf Gn) 4H A— G7) < S45 e 


This shows the necessity of the condition of the theorem. 

Let us prove the sufficiency of this condition. Let a function f(x) be defined 
in a neighbourhood of a except possibly at the point a itself and let for any 
e > 0 there exist a neighbourhood U(a) such that |/(x’)—/(x")] < e for 
all x’, x" € U(a) (x’, x” # a). Taking an arbitrary sequence {xn}, x, ~ a 
(n = 1,2, ...) tending to a we can assert that, according to Cauchy's 
criterion for convergence of a sequence, there is a natural number N such 
that Xn, Xm € U(a) for n, m > N. Then 


VQ) —fGw)l < € (n, m > N) 


Consequently the sequence { f(x,,)} satisfies Cauchy's criterion and thus has 
a limit. 

We have proved the following property of the function funder considera- 
tion: for any sequence of numbers x, = a convergent to a there exists the 
limit lim f(x,). This property implies automatically that all these limits 
lim f/(x,) corresponding to all the possible different sequences tending to 
a are equal to each other. This means that the limit lim f(x) exists. Indeed, 


x-0 
let x, > aand x, + a(x,, x, # a; n = 1,2, ...). Then, as we have shown, 
there are numbers 4 and J’ such that /(x,) — A and f(x;) — A’. Let us 
construct the new sequence (xi, xi, X», X2, X3, ...). It converges to a. By 
what has already been proved, the corresponding sequence (/(x:), f (xi), 
f (xa), f(x) f (xa), -..) should also converge, which is only possible if 
A= A’. Hence, A = A’. 
The theorem has been proved. 
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Theorem 6. Let 
lim f(x) = 4 and limg(3»)-2 B 
x-a 


where A and B are finite numbers. Then 
lim [f/(x)9(xX)) = ALB and lim[f(x)-¢(x)] = AB 


and if B # 0 then also 
li f(x) _A 


xa P(X) B 





As an instance, let us prove the second equality. Let x, — à, Xn zd 
(n = 1,2, ...); then 


lim f(x) = A and limg(x,) = B 


Since the limit of the product of two variables running through some sequences 
is equal to the product of the corresponding limits we have 


lim [f'(%n) e(x,)] = lim f (x,) lim g(x,) = AB 


This equality has been proved for any variable x, -- a, x, = a and therefore 
tm [/ 69909] = AB. 


"According to the definition, Hum nf (x) =o if the function f(x) is defined 


in a neighbourhood of a except possibly at the point a itself and if for any 
positive number M there is a neighbourhood U(a) of the point a such that 


Sœ =M  (xeU(a, x # a) 
If lim f(x) = æ and if the function f(x) satisfies the inequality f(x) > 0 


(f(x) « 0) ina pisa of a we also write 


limfQ)-- (mfG) =- =). 


It is easy to prove the following theorems: 
Theorem 7. Jf a function f(x) satisfies the inequality 
If@)| > M > 0 
in a neighbourhood of a and if a function q(x) is such that 
limg(x)=0 (g(x) #0 for x # a) 
then Lu 


——— = oO 


xa PIX) 


20006—7 
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Theorem 8. If lim f(x) = A and lim g(x) = œ (where A isa finite number) 
x-aü x-a 


then 


Corollary. If p(x) — 0 (x — a, p(x) + 0) then 
: 1 
ima -- 
and if p(x) — œ (x + a, p(x) #0) then 
1 


lim p(x) zi 


Theorem 9. Let a function f defined in a neighbourhood of a point a (which 
can be finite or infinite) satisfy the following condition: every sequence i 
convergent to a P Lisa a subsequence (x,) such that lim (Xn) = 
Then lim f(x) = ae 


-a 
Proof. Let x, — a. ocn to the hypothesis, any subsequence of the 
sequence (/(x,)) contains a subsequence convergent to A. Therefore, by 
Theorem 5 in 8 3.8, we have f(x4) — A 


§ 4.2. Continuity of a Function at a Point 


By definition, a function f is said to be continuous at a (finite) point a 
if it is defined in a neighbourhood of that point (including the point a itself) 
and if 

limf (x) = f(a) (1) 


By what was said in § 4.1 about the limit of a function at a point, the defini- 
tion of the continuity of a function at a point stated above can be formulated 
infullasfollows: = = 8 —.... 

A function f is said to be continuous at a point a if it is defined on an interval 
(c, d) containing the point a and if for any € > O there is 6 => O such that the 
inequality 


If)-S@I < e 


holds for all x satisfying the inequality |x—a| < ò. 

By virtue of $ 4.1, this statement of the definition is completely equivalent 
to the following. 

A function f is said to be continuous at a point a if it is defined on an interval 
(c, d) containing a and if for any sequence (x,) convergent to a there holds the 
relation 


lim f(x.) = f(a) 
Xaa 
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If a function f(x) defined in a neighbourhood of 4 noit n 3e not continuous 
at the point a, that is if the property indicated abd e doas not hold for it, 
we say that f is discontinuous at the point a or that it has a discontinuity at à 
(a point a of this kind is called a point of discontinuity of f) 

The discontinuity of a function fat a point a can also be defined in a direct 
manner: 

Let a function f be defined in a neighbourhood of a point a and let there be 
a number & > 0 such that for any ô > O there exists a point x, such that 


la— x| <6, I(x) = & 


Then f(x) is said to be discontinuous at the point a. 





o X978 Xo Xo+Ò. x 
Fig. 4.2 


Let us consider a continuous curve C representing graphically a continuous 
function y = f(x), x -€ [a, b] (see Fig. 4.2). The term “continuous curve” 
‘is used here in an intuitive sense meaning that it can be entirely drawn with 
a “continuous” motion of the pencil without-leaving the paper. 

Let us take an arbitrary value xo € (a, b). The value of the function in 
question corresponding to xo is /(xo). Setting £ > 0 and drawing the three 
straight lines parallel to the x-axis and passing respectively at distances 
f (xo)— E, f (xo) and f(xo)-- & from the x-axis (see Fig. 4.2) we readily see 
that for the (continuous) curve in question it is possible to find 6 > 0 
(dependent on £) such that all the ordinates f(x) of the curve corresponding 
to the values of x belonging to the interval (xo— ô, xo--9) satisfy the in- 


equalities 
f (xo) E < f(x) < f(xo)t € 
In other words, for any £ > 0 there is ô > 0 such that the inequality 
f(x) —/(xo)] = € is fulfilled for all x satisfying the inequality | x— xo] < ô. 
Hence, the mathematical definition of the continuity of a function is co- 
herent with the intuitive idea of a continuous curve. 
7* 


100 A COURSE OF MATHEMATICAL ANALYSIS 


Let us consider the graph shown in Fig. 4.3. This graph represents a 
discontinuous curve L consisting of the two disjoint continuous parts L; and 
Ls. The part L, is projected in a one-to-one manner (in the direction of the 
y-axis) on the interval [a, c]. As to the part L», we suppose that its left end 
point is deleted; the latter part is projected in a one-to-one manner on the 
half-interval (c, b]. To each value x c [a, b] there corresponds a single value 
y = f(x) equal to the ordinate of the point of the curve L having the abscissa 
x. The curve L is discontinuous since it consists of two disjoint parts L, and Le 


l2 


f(c) 





f()-&g-——— -Z — ~i- -f- -b- --- 


“not pasted together”. The discontinuity is encountered as the moving 
point with abscissa x passes through the point c (or, as we say, as the value 
of the argument x passes through the value c). As is shown in Fig. 4.3, 
f(c) = Ac. It is readily seen that the function f(x) is also discontinuous at 
the point c. Indeed, let us take a positive number £9 < AB. Observing the 
figure we conclude that for any à > 0, however small, there are values of x 
among those satisfying the inequality le-x| = ô (namely, the values 
exceeding c and differing from it by less than ô) such that 


If(x)—F(C)| > £o 


Thus, to a discontinuous graph there corresponds a discontinuous function. 
In the case under consideration the function f(x) is discontinuous at the 
point c (cf.§ 1.4). 

The difference Jy = Af(x) = f(x-- fh) —f(x) is called. the increment of 
the function f, at the point x, corresponding to the increment h of the indepen- 
dent variable. 

The concept of continuity of a function fat a point a can also be defined 
as follows using the notion of increment: a function f(x) is continuous at a 
point a if the expression f(a--h) regarded as a function of h is defined in a 
neighbourhood of the point h = O and if, given an arbitrary s > O, there is 
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ô > O such that the inequality 
[f(a+h)—f(@)| < e 


holds when |h| < 6. 

In other words, a function fis continuous at a point a if its increment at 
this point corresponding to the increment h of the argument tends to zero 
together with h. 

The properties of limits of functions (see § 4.1) and the definition of the 
continuity of a function at a point imply 


Theorem 1. Zf functions f(x) and (x) are continuous at a point a their sum 
S(x)+9(x), difference f(x) —q(x), product f(x)p(x) and quotient f(x)/g(x) 
(the latter is considered under the additional assumption that ¢(a) # 0) are also 
continuous at the point a. 

We shall also prove the theorem on the continuity of a function of a 
function. 


Theorem 2. If a junction p(x) is continuous at a point aand a function f(y) is 
continuous at b = (a) then the function of a function (the composite function) 
F(x) = f(g(x)) is continuous at the point a. 

Proof. Let us take an arbitrary £ > 0. By the continuity of the function 
fat the point b, there is æ > O such that the function f(y) is defined on the 
interval (b—o, b 4- o) and the condition 


If/0)—f(B) «e for |y—b] «c Q) 


is fulfilled. Furthermore, by the continuity of the function y at the point a 
there is 6 > O such that the function g(x) is defined on the interval (a — ô, 
a+6) and the inequality |9(x) —g(a)| < c holds for all x satisfying the in- 
equality 

Ix—a| <6 (3) 


It follows from the relations obtained that the function f(g(x)) is defined 
for all x satisfying inequality (3) and that for these values of x there holds the 
relation 


LO) -IP <2 thatis |F(x)—F@| < e (4) 


which is what we set out to prove. 

To prove the continuity of F at the point x = a we can also use the 
following argument. Since the function ọ is continuous at the point a and 
the function f is continuous at the point b = p(a) and, besides, F(a) = 
= f(q(a)), we must have the relation 


lim FG) — Tim AO) =P) = FG) 


for any sequence {x,} tending to a. 
If a function ©(x) is obtained from several functions by applying to them 
only the arithmetical operations and the operations of forming a function 
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of a function, the verification of the continuity of © at a given point reduces 
to a consecutive application of the last two theorems provided that these 
theorems are used a finite number of times. 

Here we also state the following theorems which are a direct consequence 
of the definition of continuity of a function at a point and of the theorems 
on the limit of a function in§ 4.1. 


Theorem 3. If a function f(x) is continuous at a point a there exists a 
neighbourhood U(a) of the point a in which the function f(x) is bounded. 


Theorem 4. Ifa function f(x) is continuous at a point a and f(a) # O then 
there is a neighbourhood U(a) of the point a at whose all points the inequality 


L(x) > Vt 
is fulfilled. Moreover, if f(a) > 0 then 


£9 fo)  (xeU() 
and if f (a) < O then 
s< (eua) 


Example 1. The constant function f(x) = C is defined and continuous 
for any value of x because its increment corresponding to any increment h of 


the argument is 
AC —- C-C —-0 


and therefore the condition JC — O (h — 0) is fulfilled automatically. 


Example 2. The function f(x) = x^ (n = 1, 2, ...) is defined throughout 
the real axis and is continuous on it. 

Indeed, the function y = x is obviously continuous for any x, and hence 
so is the function x? = xx. The same argument shows that the function 
x = xx is also continuous: proceeding in this way we conclude, by induc- 
tion, that the function x^ is continuous for any n. 


Example 3. A polynomial 
P(X) = aox"-- ax" 1 d-aox"7?-- ... 4- a, 


(where ao, ..., a, are given numbers and zx is a natural number) is obviously 
a continuous function for any x since, as has been shown above, x"-* 
(k = 0,1, ..., n) is a continuous function throughout the real axis and so is 
the function a,x"~* as the product of two functions a; and x"-^ which are 
continuous for all x; finally, P(x) is continuous on the real axis as a finite 
sum of continuous functions. 


Example 4. A rational function 


_ PIX) — aw... +a 
JG) = Gay = amt rb. 
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(where n and m are natural numbers and ax, b, are given real numbers) is 
continuous for all the values of x for which Q(x) = 0. This follows from 
the fact that f(x) is obtained from the continuous functions x* and from a 
finite number of real (constant) 
coefficients by means of a finite 
number of arithmetical opera- 
tions (addition, subtraction, mul- 
tiplication and division). 


Example 5. The function f(x) = 
= sin x is continuous at all the 
points x. This is shown by the fol- 
lowing argument. 

We can easily prove the in- 
equality [sin Aj = |A|. To this end 
we first prove it for |A| 2c/2: on 
multiplying the desired inequality 
(its both sides) by 2 we obtain on 
the left-hand side the length of 
the chord (see Fig. 4.4) subtend- 
ing an arc with length 2]A] of a Fig. 4.4 
circle of unit radius; the inequality 
thus obtained is obviously valid and is equivalent to the former inequality. 
Now, taking [A] 2- 2/2 we can write |A] 2 z/2 > 1 = sin A whence 





2 


which means that |sin (x+A)—sin x| + 0 as h — 0, that is the function 
sin x is continuous at any point x. ern n 


sin (œ+) -sin x] = |2 sin 2 cos (x+4)]=2/3/1 = jh] 


Example 6. The function cos x is continuous for all the values of the 
argument x since 


TE" h hl. E. 
[cos peri sens x| = |2sin sin (x43) |<2/ 2| =|h|~-0, h-0 
The inequality obtained shows that for any e there is 4, namely, in this 
case 6 = e, such that |cos (x--/) — cos x| < e when [h| < 6. 
Remark. In our course we rely upon the ordinary geometrical definition 
of trigonometric functions (see § 1.3, 7). But it is also possible to state 


some other definitions of the trigonometric functions which are of a purely 
analytical character (see § 10.11). 


Example 7, The function |x| is continuous for all the values of x since 
I|x+h|—|x]| s |x+h—x] = lh] +0, h~O 


If a function fis not continuous at a point x = a and, at the same time, 
there exists a finite limit lim f(x) we say that the function has a removable 


x—a 
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discontinuity at that point. This term is accounted for by the fact that in 
this case the function f can be redefined at the point a (provided that it is 
defined at a) or extended to the point a (if it was not originally defined at a) 
by putting f(a) = lim f(x) so that the (nearly defined!) function fis conti- 


xa 


nuous at that point. 


Example 8. The function 


Æ- for x21, 


f= ei 
\ 3 


for x = 1 


is obviously discontinuous at the point x = 1. But this discontinuity is 
removable since if we put /(1) = 2 the (new) function f becomes continuous 
at x = 1. 

If a function f is continuous for all x in a sufficiently small neighbourhood 
of a point a except possibly at the point x = a itself and is unbounded in 
this neighbourhood we say that f has an infinite discontinuity at a. 


Example 9. Tbe function sin (1/x) is an example of a bounded function 
having an unremovable discontinuity at x = 0 while tan x is an example of 


a function having infinite discontinuities (at the points x, = rim, 
k=0, +1, Ehan) 


Example 10. The functions cos (sin x?) and (sin x)? are continuous through- 
out the real axis. This follows from the continuity of the functions x?, sin x 
and cos x and from the theorem on the continuity of a function of a func- 
tion. 


$ 4.3. Right-hand and Left-hand Limits of a Function. 
Monotone Functions 


Let us state the following definitions. A left-hand neighbourhood of a point 
(number) a is an arbitrary half-interval (c, a] and a right-hand neighbourhood 
of a is an arbitrary half-interval [a, d) (c < a < d). By a neighbourhood of 
(“the point") +æ is naturally meant an arbitrary (semi-infinite) interval 
(N, +œ) and by a neighbourhood of — œ an interval (— œ, N) where in 
both cases N is an arbitrary (finite) number. In accordance with this termi- 
nology we can say that the neighbourhoods of + œ and — e» are respectively 
left-hand and right-hand neighbourhoods of (“the point”) œ. Right-hand 
and left-hand neighbourhoods are also termed one-sided neighbourhoods. 

Proceeding from these definitions we introduce the notions of the right- 
hand and left-hand limits of a function f at a point a (which can be finite or 
infinite). For instance, we call A the right-hand limit of fat a (finite or infinite) 
point a if fis defined in a right-hand neighbourhood of a except possibly 
at the point a itself and if for any € > 0 there is a right-hand neighbourhood 
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of a such that the inequality |f(x)— 4] ~< e is fulfilled for all the points x 
belonging to the latter neighbourhood. 

The right-hand (left-hand) limit of fat æ is usually called the limit of f for 
x—— (für x ++). 

We can also state the following alternative definition of a right-hand 
(left-hand) limit at a point. A function f is said to have a right-hand (left-hand) 
limit at a (finite or infinite) point a equal to a number A if the function fis 
defined in a right-hand (left-hand) neighbourhood of a except possibly at the 
point a itself and if lim f (x,)= A for any sequence (x,), x, # a, convergent 


Xama 
to a on condition that the values of the sequence belong to that right-hand 
(left-hand) neighbourhood. 

The equivalence of the definitions stated here is proved by a complete 
analogy with the case of an ordinary limit (see § 4.1). The theorems on 
limits in § 4.1 are extended by analogy with right-hand and left-hand limits. 

If ais a finite point the right-hand and left-hand limits of fat this point are 
symbolized respectively as 


f(a--0) =lim f(x) and f(a—0) = lim f(x) 


x>a Scd 
Using the definitions of limits expressed in the “e, ô language" we can 
readily prove that for a function f to have a limit at a finite point a it is 
necessary and sufficient that there exist the right-hand and left-hand limits 
of f at this point and that these limits coincide; then /(a4-0) = f(a—0) = 
= lim f(x). 


x-a 
The limits of f for x — — =, x —--e» and x+co are respectively 
denoted as 


um S0) =f- =), Aui Je eC) and lim f(x) = f(=) 


Here, like in the case of a finite point, there holds the following obvious 
assertion: for the limit of f for x + e» to exist it is necessary and sufficient 
that the limits of f for x > + œ and for x + — œ should exist and coincide; 
then f(— e) = f( =) = f(e). 

Up till now we have dealt with finite limits of functions (i.e. the number A 
has been supposed to be finite) but by analogy with the above we can also 
introduce limits of the type 

lim — 4 
where a and A are finite numbers or + œ or — œ or œ (all the combina- 
tions are allowable). 

For example, in the case a = A — — œ we deal with the symbolic rela- 
tion lim f(x) = — œ which means that the function f(x) is defined for all 


tem ee 


the values of x less than a certain finite number (i.e. in a neighbourhood of 
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— c») and that for any positive number N there is a number L such that the 
inequality f(x) < —N holds for all x < L. 

Right-hand and left-hand limits are of great importance for the study of 
monotone functions. 

Let E be a set of real numbers (of points of the real line). A function f de- 
fined on E is called nondecreasing (nonincreasing) on E if the relations 
x’, x" € E and x' < x” imply f(x’) = f(x”) (fox) = f(x"). 

"Nondecreasing and nonincreasing functions on E are termed monotone 
functions on E. 


Theorem 1. Let a function f be nondecreasing on an interval (a, b) where, in 
particular, there can be a = — œ or b = + (or both). If the function is 
bounded above by a number M then there exists a ( finite) limit lim afi (x) « M. 
Jf it is not bounded above then lim f(x) =+. 1 

Proof. The boundedness of f implies the existence of the supremum 

sup. f(x) = A = M. Hence, f(x) = A forall x € (a, b), and for any £ > 0 
x € (a, b) 
there is x; € (a, b) such that A—e < f(x1) = A. Since f is nondecreasing 
we have f (x1) = f(x) for xı = x < b. Thus, for any e > O there is xı =b 
such that A—e < f(x) « A + eforall xsatisfying the inequalities x, « x <b. 
This exactly means that 
A = limf(x) 

x-b 

xb 

Now let a nondecreasing function f be not bounded above. Then for any 
M there is x; € (a, b) such that M < f (x1), and, since fis nondecreasing on 
(a, b), we have 


M «f(x)«f() for xi«x-«b 
which means that 
lim f(x) = 
x-b ` 
x«b 
The following theorem is proved by a complete analogy with the above. 
Theorem 2. If a function f is nondecreasing on (a, b) (where there can be 


a =— orb =+ e, or both) and if f(x) is bounded below by a number m, 
there exists a ( finite) right-hand limit of the function f at the point a: 
lim f(x) = 42m 


xaea 
x>a 


If the function f is not bounded below then 


x-üu 
xa 
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Let the reader modify the statements of these theorems for the case of a 
nonincreasing function defined on (a, b). 


Example. Consider the function 
for O«<x<1l, 


fe y= ft +1 for l«x«2 


defined on the closed interval [0, 2]. It is one-valued and monotone on 
[0, 2]. As is readily seen, /(1—0) = 1 and f(1+0) = f(1) = 2. 


Theorem 3. If a function f is nondecreasing on a closed interval [a, b] then at 
each point x € (a, b) there exist the limits f (x — 0) and f (x+ O) and the inequali- 


ties 
f(x—0) « f(x) =f(x+0) 
hold. The limits f (a-- 0) and f (b — 0) also exist and satisfy the inequalities 
f(a) =f(a+0), f(b—0) «f(b) 


This theorem follows immediately from the foregoing theorems if we take 
into account that its conditions imply that the function fis nondecreasing on 
each of the intervals [a, x] and [x, b}. 

Now we can introduce the notions of continuity of a function from the 
right and from the left at a given point. 

A function f is said to be continuous from the right (from the left) at a 
finite point a if f(a+0) exists and f(a+0) = f(a) (if f (a —O) exists and 
f(a—0) = f(a)). 

If for a function f there exist the (finite) numbers f(a — 0) and f(a+0) at 
a (finite) point a and if the function is nevertheless discontinuous at a we 
say that the function has a discontinuity of the first kind at the point a. 

It should be noted that if a function f is continuous both from the "eM and 
from the left at a point a it is obviously continuous at the point a. 

We can also say that for a function f (x) to be continuous at a point a itis. 
necessary and sufficient that the three numbers f(a—0), f(a) and fi (a+0). 
Should make sense and coincide with each other. 

In Figs. 4.5-4.10 we see the examples of six graphs representing functions 
having discontinuities of the first kind at a point a. Here the letter A desig- 
nates the point A= (a, (a)) in the xy-plane. An arrow placed at an end point 
of a portion of a curve symbolizes that this end point is deleted from the 
graph. In Figs. 4.5-4.8 we see the cases when all the three numbers f(a), 
J(a—0) and /'(a 4-0) make sense for the depicted graphs of certain functions 
f. In Fig. 4.5 the numbers /(a), f (a — 0) and f(a +0) are pairwise different; 
the corresponding function is not only discontinuous at a but is also dis- 
continuous from the right and from the left at a. In Fig. 4.6 the function f 
is continuous from the left at a. In Fig. 4.7 the function f is continuous 
from the right at a. In Fig. 4.8 we see the case of a removable discontinuity 
of f at a. The function f whose graph is shown in Fig. 4.9 is not defined at a 
and the discontinuity is unremovable. Finally, in Fig. 4.10 the function f is 
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a x = a x 
Fig. 4.9 Fig. 4.10 


not defined at a but f can be extended to a so that it becomes continuous 
at a. 

Attention should be paid to the following important fact. If a function f 
defined on a closed interval [a, b) is monotone on it (i.e. is nondecreasing or 
nonincreasing) then the function f is either continuous or has a discontinuity 
of the first kind at each point x € [a, b]. This proposition is an immediate 
consequence of Theorems 1 and 2 and of the definition of a point of discon- 
tinuity of the first kind*. 


* On the number of points of discontinuity of a monotone function see the end of 
$9.5. 
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If a function fis defined in a neighbourhood of a point a except possibly 
at the point a itself and has a discontinuity at a not belonging to the class of 
discontinuities of the first kind the function is said to have a discontinuity 
of the second kind at a. For instance, the function sin (1/x) has a disconti- 
nuity of the second kind at the point x — 0. The function 


0 fo x<0 
Won fo x0 


also has a discontinuity of the second kind at the point x — O since, although 
the number » (0 — 0) = 0 makes sense, the number »(0+0) does not. 


8 4.4. Functions Continuous on a Closed Interval 


A function fis said to be continuous on a closed interval [a, b] (i.e. on the 
set of points x satisfying the inequalities a « x « b) if it is continuous at all 
the points of the open interval (a, b) (i.e. at all the points x for which a < x < 
< 5), is continuous from the right at the point a and continuous from the 
left at the point b*. 

A function continuous on a closed interval possesses a number of remark- 
able properties which will be presented in this section. But the extremely 
important property of uniform continuity of such a function will not be 
treated here; it will be considered later ($ 7.10, Theorem 4) for the general 
case of n variables. From the results obtained in $ 7.10 the corresponding 
results concerning functions of one variable continuous on a closed interval 
(a, b] can be readily derived as special cases. 

We begin with the following lemma. 


Lemma 1. [fall the values x, of a sequence {x,} convergent to a number « 
belong to [a, b] then also« € [a, b]. 
Proof. The assertion of the lemma follows from Theorem 3, § 3.1. 


Theorem 1. If a function f is continuous on a closed interval [a, b] it is 
bounded on it. 

Proof. Suppose that f is unbounded on [a, b]. Then for each natural 
number 7 there is a point x, c [a, b] such that 


(xn (n2L2,... (1) 

The sequence (x,) is bounded (since a and b are finite numbers) and there- 

fore it contains a subsequence {x,,} convergent to a point « € [a, b] (see 

the foregoing lemma and Theorem 3, § 3.8). The function f is continuous at 
the point œ and therefore** we must have 


Lm f(x) = (a) (2) 


* It should be stressed that when speaking of a closed interval [a, b] we always mean 
that its end points are finite numbers (points). ’ 
** If a = b (a = a) the function f is continuous from the left (from the right) at the 
point a. 
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Property (2) obviously contradicts property (1). Therefore f must be bounded 
on [a, 5]. 

It should be noted that if a function is continuous on an open interval 
(a, b) or on a half-interval of the type [a, b) or (a, b] it is not necessarily 
bounded on it. For example, the function 1/x is continuous on (0, 1] but not 
bounded on that interval. 

If we extend the function 1/x to the point x = 0 by putting, for instance, 
f(0) = 0 the new function will be finite at any point of the closed interval 
[0, 1] but is not bounded on it. 


Theorem 2. A function f continuous on [a, b] attains at some points of the 
closed interval [a, b] its maximum and minimum, that is there are points « and 
B belonging to [a, b] such that 


min f(x) - f(x) and max /f(x)-/() 
x € (a, b) x € (a, 5] 
Thus, f(a) = f(x) «f(B) for all x € [a, b]. 


Proof. By the foregoing theorem, a continuous function on a closed inter- 
val is bounded on that interval, and hence the function fis bounded above 
by a number K on [a, 5): 


fo)sK  (xela b) 
Therefore the supremum of f on [a, b] must exist: 


sup f(x) = M (3) 


x€ [a, 5] 
The number M possesses the property that for any natural number n there is 
a point x, on [a, b] such that 
M-~<f(x)<M (n=1,2,...) 


The sequence {x,} belongs to [a, b] and is therefore bounded. Hence it 
contains a subsequence {Xn,} convergent to’ a number f which is sure to 
belong to [a, b] (see Lemma 1). Since the function f is continuous at the 


point 8 we must have jim n fo) = = f(). On the other hand, M -u- 
fox) «M (k = 1, 2. Jand 
lim n f (x4) = M 
But f (xn) can have only one limit, and therefore M = f(A). 
The value equal to supremum (3) is thus attained by the function at the 
point £; in such a case we say that the function f attains at the point B its 


maximum (i.e. its maximum value) on the interval [a, b]. We have shown 
that there exists a point f c [a, b] such that 


max f(x) = f(B) 
x £ [a. b] 
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The proof of the remaining part of the theorem concerning the minimum 
of the function is proved analogously; it can also be reduced to the first part 
of the theorem because 

min f(x)- — max (— 
x € (a, b] K ) x € (a, b) { FOO} 

Remark. The function y = x is continuous on the open interval (0, 1) 
and is bounded on it; but its supremum sup x= 1 is not attained on 


x€(0,1) 
this interval, that is there is no xo € (0, 1) such that the function is equal to 1 
at xo. We see that the requirement of the last theorem that f be continuous 
on a closed interval |a, b] (which includes its both end points a and b) is es- 
sential. 
We obviously have sup arctan x = z/[2. But there is no point x on the ray 
0 


xm 
x = 0 at which the function arctan x assumes the value z/2; hence it does 
not attain its maximum for x = 0. The conditions of the above theorem are 
violated in this case since the domain of definition of the continuous function 
arctan x is not bounded. 


Theorem 3. 7f a function f is continuous on a closed interval [a, b] and the 
numbers f (a) and f (b) are different from zero and have opposite signs there is 
at least one point c on the open interval (a, b) such that f (c) = 0. 

Proof. Let us denote the closed interval [a, b] as do. On dividing it into 
two equal parts we test the value of the function f at the midpoint. If the 
function is equal to zero at the midpoint of do the proof of the theorem is 
completed. Let us suppose that it is different from zero at that point; then 
one of the two halves of the interval 4o is such that the function assumes 
nonzero values of different sighs at its end points. Now we denote that very 
half by 4, and again divide it into two equal parts. It may happen that the 
function is equal to zero at the midpoint of 4; and then the theorem is 
proved. If otherwise, we denote as 71; the half of 4, at whose end points the 
values of fare different from zero and have different signs, etc. Proceeding 
in this way we conclude, by induction, that we either encounter a point 
c € (a, b) for which f(c) = 0, and then the proof of the theorem is complet- 
ed, or arrive at the family of nested intervals 4; > J2 D ... on each of 
which the function f assumes values of both signs. Then there exists a 
(single) point c belonging to all 4,, n = 1, 2, ..., and, consequently, be- 
longing to [a, b]. It is evident that f(c) = 0 because, if otherwise, for defi- 
niteness, if f(c) > 0, then there is a neighbourhood Ue of the point c such 
that the function f(x) is positive for all x simultaneously belonging to [a, b] 
and to U,. But this is impossible because we have 4, C Ue for sufficiently 
large n and the function f cannot retain its sign of A,. The theorem has been 
proved. 


Corollary. Zf a function f is continuous on fa, b], f(a) = A, f(b) = B and 
C is an arbitrary number lying between the numbers A and B then there is at 
least one point c belonging to the open interval (a, b) such that f(c) — C. 
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This corollary can also be stated as follows: a function continuous on a closed 
interval [a, b] assumes all the intermediate values lying between its end-point 
values. 

Proof. Let us take the auxiliary function F(x) — f(x) — C where C is a 
constant number lying between A = f (a) and B = f(b). Since f is a con- 
tinuous function on [a, b], so is the function F. The function F obviously 
attains values of opposite signs at the end points of the interval [a, b]. 
Therefore, by the above theorem, there is a point c lying inside [a, b], i.e. 
c € (a, b), such that F(c) = 0, that is /(c)- C = 0, which means that 
f (c) = C. This is what we wished to prove. 


Example. The equation 
cosx—-x = 0 


possesses a root lying within the interval (0, zx). 

Indeed, the function f(x) = cos x — x is continuous on the closed interval 
[0, x] and assumes the values /(0) = 1 and f(x) =— (1+7) having op- 
dosite signs at its end points. 


Remark. For a discontinuous function defined on [a, b] the theorem stated 
above does not hold; this is readily confirmed by the example of the function 


f(x) = | 


-] for —l =x <0 
1 for O<x <1 


§ 4.5. Inverse Function 


Let us consider an arbitrary function y = f(x) defined on an arbitrary 
set E of numbers (points of the real line) and denote by E, = f(E) the image 
of E (see § 1.3). 

Let us assign to each y € £i the set of all x € E for which y = f(x). 
This is a nonempty set; we shall denote it e,. 

Thus, we have a function x = p(y) defined on E, which is many-valued in 
general case. The function (y) is called the inverse function of f(x). > 

The cases when the inverse function is one-valued are of particular impor- 
tance. This is always so when the function f is strictly monotone, that is 
when it is strictly increasing or strictly decreasing in its domain of defini- 
tion E. 

A function fis said to be strictly increasing (decreasing) on E if x', x” € E 
and x’ < x” imply f(x) < f(x") (f(x) > f(x"). 

If a ( one-valued) function f(x) is strictly increasing (decreasing) on E its 
inverse function x = q(y) is obviously also a one-valued and srictly increasing 
(decreasing) function on the image E, = f(E). 

In this case we have the obvious identities 


efc) -x  xeE and /[e0))-»»ecE 
It is sometimes convenient to denote the inverse function of f by the 
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symbol /~?: 
FLO) =% x EE and ffo) =y y EE 
Theorem 1. Let y = f(x) be a continuous strictly increasing function on a 
closed interval |a, b] and let A = f(a) and B = f(b). 
Then the image of the interval [a, b] is the interval [A, B], aud the function 
x = (y), inverse to f, is one-valued, strictly increasing and continuous on 


[A, B]. 


Remark. In this theorem “increasing” can be replaced by “decreasing” 
with the simultaneous replacement of [4, B] by [B, A]. 

Proof. Let E, = f([a, b]). By the hypothesis, 4, B € En and, since the 
function f is continuous on E = [a, b], every point of (4, 8] also belongs 
to E; (see the corollary of Theorem 3 on the intermediate values of a contin- 
uous function in $ 4.4). 

If a point y does not belong to (A, B] it cannot be the image of a point 
x € [a, b] since the given function is strictly increasing. This shows that the 
image of the interval [a, b], produced by the fi unction f, is the closed interval 
[A, B]. The (strict) monotonicity of the function y == f(x) on the interval 
[a, b] implies immediately that the inverse function x = q(y) defined on the 
interval [A, B] is one-valued and strictly monotone. Now it only remains 
to prove the continuity of the function x = ¢(y) at every point yo € [A, B]. 

Let yo be an interior point of [A, B], i.e. yo € (A, B). As is already known, 
there is a single point xe € (a, b) corresponding to Ya such that yo = f(xo) 
or, equivalently, xo = (yo). 

Let us take an arbitrary positive number e on condition that it is so small 
that [xo — £, xo+ e] c [a, b], and let y; = f/(xa— £) and y» = f(xo+ €). The 
strict monotonicity of f implies that the values x = y(x) corresponding to 
all y € (ys, yz) belong to the interval (xo— €, xa-- +): x = q(y) € (xo—&, 
Xot £). 

Thus we see that for any sufficiently small « (i.c. satisfying the condition 
[Xo — £, xo+ £] c [a, b]) there is a neighbourhood (y1, yz) of the point yo 
such that |x —xo| = Ig(y) —e(vo)| = £ for all y € (yv V2) l 

The property of the function p(y) stated. here has been proved for suffi- 
ciently small £. But it is clear that it also holds for any £. This property 
exactly means that the function p(y) is continuous at the point yo. 

For the end point yo = B the corresponding point is xo = b = g(yo). 
Putting xı = b—e-- a and yj = f(x1i) we obviously obtain !¢(yo)— 
—9(y)| = e for all y € (ys Yo]. 

The case yo = A is treated similarly. 

The proof of the continuity of the function x =: q(y) (the inverse of the 
function y — f(x), the latter being supposed to be continuous and strictly 
monotone on [a, b]) can also be carried out in another way. Let us set a 
value yo € [4, B] and choose an arbitrary sequence of points y, € [4, B] 
such that y, — yo. Putting xo = ¢(yo) and x, = q();) we can write yo = 
= f(xo) and y, = f(x,). The continuity of q at the point yo can now be 
proved if we show that x, — xo. 


20006—8 
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Suppose the contrary. Then there must exist a subsequence {x,,} conver- 
gent to a point x’ € [a, b] distinct from xe. By the strict monotonicity of f 
we then have f(xo) z f(x). 

But, according to the hypothesis, f(x,) = y», — yo = f(xo), and, by 
the continuity of f, 

fou) ~ fo) tue >V 


We have thus arrived at a contradiction because the given sequence {f(Xn,)} 
cannot converge to different limits. 


Example. The function y = sin x is continuous and strictly increasing on 
the interval [— z/2, 7/2). The image of this interval under the mapping 
specified by the function sin x is the interval [—1, +1]. By the above 
theorem, there is a one-valued continuous and strictly increasing function 
defined on the interval [ —/2, 7/2] which is the inverse of sin x. As is known, 
this function is designated as x = arcsin y ([— 1 = y = 1)). 

The inverse function corresponding to the function y — sin x regarded 
on the whole real axis is no longer one-valued; it is infinitely valued and 
toeach y € [— 1, +1) there corresponds the set e, of values of x determined 
by the formula 


x = Arcsin y = ( — 1) arcsin y+ kx (k = 0, +1, 42,...) (D 


Theorem 2. Let y = f(x) be a continuous strictly increasing function 
defined on an open interval (a, b) and let 


A= inf f(x) and B= sup f(x), x € (a, b) (2) 


where, in particular, a or A (or both) can be equal to — o» while b or B 
(or both) can be equal to + œ. 

Then the image of (a, b) is the open interval (A, B), and the function x = q(y) 
inverse to f, is one-valued, strictly increasing and continuous on (A, B). 


. Remark. In this theorem “increasing” can be replaced by “decreasing”; 
then the image of (a, b) will be (B, 4). ` 

From the definition of the number B it follows directly that if it is finite 
then the point y > B cannot belong to the image /((2, b)). The number B 
itself cannot belong to f((a, b)) either, because, if otherwise, there would 
exist a point x; € (a, b) such that B = f(x1) and, since we can take a point 
Xs > xı belonging to the interval (a, b), the strict monotonicity of f would 
imply the inequality f(x») > B = f(xi) which contradicts the definition 
of B. 

In just the same way we can prove that the number A does not belong to 
J((a, b)) either if it is finite. Hence, the image f((a, b)) is contained in (A, B). 
But these two sets do in fact coincide. To prove this let us take an arbitrary 
point y € (A, B). By definitions (2), there must exist x3, x» € (a, b) such 
that 

yim f(x) < y < f(x2) = ys 
and, since f if strictly increasing, x1 < x2. The function f(x) is continuous 
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on (a, b) and, moreover, it is continuous on [x1, x2]. Therefore when x runs 
through the closed interval [x,, x2] the function f should assume all the 
values between y; and y» and, consequently, the value y as well. 

This means that there is a value x = ¢(y) (which, by virtue of the strict 
monotonicity of f is unique) such that y — f(x). Hence we have proved that 
the image of the interval (a, b) is the interval (4, B) and that the function 
x = p(y) defined above is the inverse function of f. 

The function ¢ is continuous at the point y since y can be regarded as the 
inverse function of f considered as a function defined on the closed interval 
[x1, x2], and to the latter function we can apply the foregoing theorem. 
The fact that ¢ is a strictly increasing function is quite obvious. The theorem 
has been proved. 


Remark. The intervals (a, b) and (A, B) in Theorem 2 can be respectively 
replaced by half-intervals, for instance, by [a, b) and [4, B); in this case a 
and A are finite numbers. 


D a . 
Example. Let us consider the expression Ya where a > 0 and n is a 
natural number. The nth arithmetic root of a is a positive number whose 
nth power is equal to a. This number is also denoted as 


Ya — au (3) 


The existence and the uniqueness of this number are established as follows. 
The function 
yax (4) 


is continuous and strictly increasing on the half-interval [0, ~) and, besides, 
it is equal to zero for x = 0 and tends to + e» together with x. On the basis 
of Theorem 2 and the remark to this theorem we conclude that the function 
y = x" possesses an inverse function x = q(y) (0 =p < æ) which is one- 
valued, continuous and strictly increasing; x = p(y) is equal to zero for 
y = O and tends to + œ together with y. 

Consequently, for any y € [0, e) there is a single positive number x = 
= p(y). such that [p] — y. This. exactly means that p(y) = y". In 
particular, putting y = a we conclude that the mth arithmetic root of a 
exists and its value is determined uniquely. 


8 4.6. Exponential and Logarithmic Functions 


The Function a*. Let a > 0 be an arbitrary positive number. If n is a 
natural number, the number a" is defined as the product a^ = a... a of n 
factors each of which is equal to a while the number c" is understood as 


a 
the nth arithmetic root of a: a" = ya. 
Now let p/q (q > 0) be a nonnegative rational fraction. By definition, 
we put 
apla = (arya = (a!) and =a = | 


8* 
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The proof of the equality (a?)!/« = (aV)? and of the fact that this defini- 
tion leads to the same number when the fraction p/q is written as np[nq = 
= plq where n is an arbitrary natural number is known to the reader from 
elementary mathematics. Further, we also put, by definition, 

z l 
arla = p 
Thus, we have defined the function a* (a > 0) for any rational values of x. 

Let WM denote the set of all rational numbers. The function a* is defined 
on this set. In elementary mathematics it is proved, on the basis of the axioms 
of real numbers entering into Groups I-IV only, that 


arty = a*a* (1) 


for any x, y € W. [n elementary mathematics it is also proved that a* « a” 
(x «yix,y€9,a-l) 

We shall prove that the function a* cun be extended to all irrational points 
so that the extended function, which we again denote a*, is defined and con- 
tinuous throughout the real axis R. Moreover, the extended function possesses 
property (1) for all x, y € R. 

To begin with we shall prove an auxiliary inequality (derived by Jacob 
Bernoulli). 

If a — 1 and N is a natural number then a'N = 1+} where 4 — 0. 
Whence, taking into account Newton's binomial formula, we obtain a — 
= (1+5 > 1--NÀ, ie. aN —1 < (a—1)/N. 

Now, if h is an arbitrary positive rational number satisfying the inequality 
0 —A <1, there is a natural number N such that 1/(N-- 1) <A «1/N. 
Therefore we have 

ahy aay Sel = INST (a.i) "T < Xa- Dh 
for a > 1. Further, 1—a^^ = (a^— l)ja* < a^—1 < 2(a—1)h. The last 
two inequalities and the fact that a? = ] imply Bernoulli’s inequality 


ia^—li«2(a—l)h| — (hal, a= 1) 


which holds for all the indicated rational numbers h. 
From Bernoulli’s inequality we obtain 


æ —a* = a*(a"7*—])«2a'(a—Y)(y-x) (ye, 0«vr-xal (2) 


Let us take an arbitrary number c and denote by We the set of all x € M 
satisfying the inequality x « c. 
It follows from (2) that 


a'—a«M(y-x (x, ye Me, 0 y-x«l, M = Xa-1)a) (3) 


where M is thus a constant independent of the values of x and y in question. 


* Jacob Bernoulli (1654-1705). a Swiss mathematician. 
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Inequality (3) says that if the difference between x and y. is small the 
difference between the corresponding values of the function is also small. 
More precisely, given an arbitrarily small e > 0, the inequality 


la —a*| < e (4) 


holds for all x, y € W- satisfying the inequality : ix-yi < ò where 6 > 0 is 
sufficiently small (namely, for 6 < min (e/M, 1j). 

The property of the function a* which we have established describes its 
uniform continuity on the set W.. The general notion of the uniform contin- 
uity of a function will be studied in §§ 7.10, 7.11; here it is only mentioned 
in connection with the concrete function under investigation. 

Let xo be a rational point such that c > xo, that is xo € Me and let the 
variable x, run through some values belonging to Mt, and tend to xe. 
Then it follows from (3) that |a*»— a*e| « M | x,— xol for sufficiently large 
n, i.e. |a?» — a*»| + 0, which means lim a*» = a*», 

Now let xo be an arbitrary irrational point such that c > xo and let a 
variable x, run through some values x, € IN; and tend to xo. We shall 
show that there exists the limit of a?» as x, — xo which is independent of 
the way in which x, approaches xo. This property justifies the notation 
a” for this limit: 


ae = lim as (5) 
Xn Xo 
Indeed, since x, — xo, Cauchy’s criterion for the existence of a limit implies 
that, given any e, there is N such that |x,— x,,| = €/M for all n, m > N. 
Therefore, by virtue of (3), we have 


Jat, — a*m] < € for all n,m > N 


The last condition shows that, according to Cauchy's criterion, limit (5) 
exists. It is independent of the way in which x, tends to xo and therefore if 
x, is another variable assuming some values belonging to M. and tending 
to xo, inequality (3) indicates that 


[2*» — a] « M | x, — x51 — 0 


Thus, the function a* (a — 1) has been extended to the whole set R of all 
the points of the real line. Let us dwell on the properties of this function. 
If x, y < c, |x—y| = 1 are two arbitrary points (rational or irrational) 
and x, and y, are two variables, assuming some values belonging to Me 
and such that x, — x and y, — y, we have, by inequality (3), the relation 


|an — a*«| « M |yn—Xn| (6) 


which holds for all n = 1,2, ... On passing to the limit in (6) for n + œ 
we arrive at the inequality 


la*—a*| = M|y—xl (7) 
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which is fulfilled for all x, y < c, |x—y|<1. The passage to the limit is 
legitimate since the function |x] is continuous. It follows directly from 
inequality (7) that the function a* is continuous for any x < c and, con- 
sequently, for any x since c can be chosen quite arbitrarily. 

The function a* also possesses the properties 


a < a, if xey (8) 
lim a =0, lim a = -- (9) 
x=- Noto 
and 
ax TJ) = aʻa? ( 10) 


We shall prove these properties under the assumption that for rational x 
and y they are known from elementary mathematics. 

Let 4 and u be constant rational numbers such that x < 7 < u =< y and 
let x, y, € Wè be an increasing variable and a decreasing variable tending 
respectively to x and y. Then a*n < œ < a" < a whence, on passing 
to the limit, we obtain a* = a^ < a^ = a’, which implies (8). Property (9) 
is an immediate consequence of the facts that it holds when x tends to + = 
or to — e» running through rational numbers and that the function a* is 
monotone (see (8)). Finally, (10) follows from the equality a* i+» = a*«a*« 
after the passage to the limit in it. 

Up till now we have supposed that a > 1. If O < a < 1 we put 


m. 
2 J z ? 
a} 

In this case property (10) of the function a* and its contiauity also hold 

but the function a* is strictly decreasing. Finally, we put 


"= — o y a co (11) 


for all x. : 
We also note that for a natural exponent n: we have 
am = grql-1) x = (a*? ge-92sa2...c- (a*)", 


(arin) =a and axm = (axun 


and therefore 
(a*)?/a = (anp = (axe) » = axtela) 
for a rational number p/q > 0. Furthermore if y is an arbitrary positive 
number and y, — y where y, are rational, then 
a" = lim a?» = lim (a*)^» = (ay 
H-oo Aew 


and thus, for positive y, we have shown that a** = (a*)*. By virtue of (10), 
this equality obviously extends to the case of arbitrary v (since ara? = 
= ay» = a = Í). 
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The Function log, x (a > 0, a # 1). For definiteness, let a > 1. Then 
y = a* is a continuous and strictly increasing function defined throughout 
the real axis, and we have 

inf  a*—0 and Sup  a* = 4 o 
xE w, For) xE(— æ, +w) 
Hence, the function «* determines a mapping of the real axis (— œ, +) 
onto the infinite interval (0, -), and, by Theorem 2 in § 4.5, its inverse 
function is one-valued, strictly increasing and continuous on (0, e»). This 
function is called the /ogaritluz of y to the base a and is denoted 


loga y 
It follows that 
lim log;x =+% and Jimlog, x =- ee 
Nc x--0 
x>0 
(here we replace y by x). In the case a < | the argument is quite similar. 
If a < 1 the function a“ also maps the real axis (— «e, + œ) onto the half- 
axis (0, + e) but is strictly decreasing. The inverse function log, x defined 
on (0, + œ) is also strictly decreasing and we have 


limlog,v =— œ and limlog,x =+ œ 
xX xt) 
x>0 


Thus, there kold the identities 
de%xi=x(0<xN<+eo) and logad" =x (— œ< NX te) 
where a = 1, a > 0. From the properties of the function a* for x, y > 0 
it now follows that 
Sa Go? =xy= @'°Ga Xqlogay = Qi0ka x 4-log, y 
and 
log, (xy) = log, x-Flog, y 
Replacing x by x/y in the latter equality we derive 


log, x — log, y — loga = ' 
We also have 
g (ea wo y= (alos. x)» = qv los,x : (x e: 0) 
and therefore 
loga x” = y logax (441,a>0, x — 0) 
. Finally, for positive numbers a and 6 distinct from 1 the equality 
PATTERN log, a] — (alos. bjlogs a= howa = q 


` -onsequently 
log, b-log, a = 1 


x ‘asthe base e is called the natural (also Napierian) 
where e£»(x, ^nd is denoted as log. a = Ina. 


120 A COURSE OF MATHEMATICAL ANALYSIS 


§ 4.7. The Power Function x^ 


Let us consider the expression x? where b is a constant and x is a variable. 
For any given b this function is defined and positive for at least all points 
of the positive half-axis x > 0 (since in$ 4.6 we justified the definition of the 
number a* for a > O and arbitrary x). 

Using the formula 

x? = ebinx (x > 0) (1) 


(see § 4.6) we can derive all the properties of the power function from the 
properties of the exponential and logarithmic functions which are already 
known. The function x^ is obviously continuous. In the case b > 0 it is 
strictly increasing and possesses the properties 


limx* —0 and lim xê = + e 
x-0 X-—do 
x-0 
In the case b > 0 it appears natural to put 0° = 0; then the function x* 
becomes continuous from the right at the point x — O. 
In the case b < 0 the function x^ is continuous and strictly decreasing 
on the positive half-axis and possesses the properties 


limx? =+ e and lim x*-0 
x-0 Xo 
r0 


Formula (1) implies a characteristic property of the power function: 
(xy)? = ebliln) = gbinxebiny — xby? (xy > 0) 


In Figs. 1.2, 4.11 and 4.12 we see the graphs of the function x^, x > 0, 
for several positive and negative values of b.. 





o 1 o 1 x 
Fig. 4.11 Fig. 4.12 
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For the negative values of x the power function x^ makes sense as a real 
function when 6 is an integer or a rational number p/g with an odd denom- 
inator q. f 


§ 4.8. More on the Number e 


In § 3.5 we considered the function 
a(n) = (1 +4)" 


of the integral argument n and showed that if n — running through the 
natural numbers the variable «(1) tends to a limit which is called the number 
e. But the expression (1) does in fact make sense for any nonzero real values 
of n, and we shall show (this is important for applications) that 
lim a(n) =e (1) 
Ro 
where the limit is understood as the limit of the function a(n) defined for all 
(real) n # O. 

To prove (1) it suffices to justify (1) for the following two cases: (1) 
n — 4- œ and (2) n + — œ (in both cases n runs through any real values, 
not necessarily integral ones). 

Let us take an arbitrary e > 0 and choose N > 0 such that 


e—e < (iz <e, (142) < 1+ 


for all natural n > N. Now, if n > N+ 1 is an arbitrary real number and 
[n] is its integral part then [7] > N, and we can obviously write 


e-e< (1+ aut) < (ew) < (eu «e (ieu) < 





€ 


< e(1+<) = e+e 


Therefore (1 +1 a — e às n — +æ and, since 1+— > 1, we see that 
(1) holds when n tends to plus infinity in an arbitrary way. 


Now let us take the case when n + — œ. Putting m = —n — + co we 
see that s MN sage 
Ure oer ae | aay 
ZA 


whence follows that (1) holds for n -- — œ. Thus, we have proved (1) for 
the general case. 
Putting h — 1/n we also obtain 
: : ] Ya 
Vh — — = 
lim (1 +h) lim (1+ =) e 


new 
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§ 4.9. lim 5 * 
xo 7 
In this section we shall prove that 


sin x 


lim —— = 1 (1) 


x-0 


* 


The function (x) = is defined for all the values x = 0. Let 


0 < x < 7/2; then (see Fig. 4.13) we have sin x < x < tan x because half 
the chord subtending a 
circular arc js less than 
half the arc which, in its 
turn, is less than half the 
length of the polygonalline 
circumscribed about the 
arc. Hence, 1 < x/sin x < 
< 1/cos x, i.e. 


(sin x) 


cos x < HT < 1 (2) 


These inequalities obvio- 
usly hold not only for the 
positive values of x but 
also for the negative ones 
satisfying the inequalities 
* 0 < |x| «ac/2 since the 
Fig. 4.13 functions entering into (2) 
areeven. The functioncos x 

js continuous (see $ 4.2, Example 6) and consequently 





lim cos x = cos 0 = 1 


X-D0 
On passing to the limit in relations (2) as x — 0 we see that the limits of 


the leftmost and rightmost members of (2) coincide with 1 and hence the 
limit of the middle term in (2) also exists and is equal to 1. 


8 4.10. Order of a Variable. Equivalence (Asymptotic Equality) 


We say that fis of the order of p on E and write 
J(x) = Olx) on E (1) 


ife)I = Clea) on E (2) 


where C is a positive constant independent of x. 
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In particular, the symbolic relation 
f(x) = O01) on E 

means that f is bounded on £. 

It is obvious that if f(x) = O(qi(x)) on E and gi(x) = O(qs(x)) on E 
then f(x) = O(¢2(x)) on E. 

Examples 

l. sin x = O(x) on (- eo, -t æ). 

2. x = O(x®) on [1, œ] (but not on (0, 1]); itis evident that x? and x cannot 


be interchanged here. On the other hand, x* = O(x) = O(1) on [0, 1]. 
We shall write 


fd) = os) Gr a) (3) 
and say that the function f is of higher order (of smallness) than y. as x — aif 
f(x) = e (x) p(x) (3) 

where the function &(x) tends to zero as x — a. 

We shall write 
f(x) = O74) (2) (4) 
if there is a neighbourhood U(«) of the given (finite or infinite) point a such 
that 

I(x) = Op) | (€ Ula), x = a) (4) 


It is of course tacitly implied here that both functions f and y in definitions 
(3) and (4) are defined in some common neighbourhood of the point a except 
possibly at the point a itself. If there is such a neighbourhood on which 
p(x) z 0 everywhere except possibly at the point a itself, definitions (3) and 
(4) are obviously equivalent to the following ones: f(x) = o(g(x)) as x — aif 

lim 22 = 0 (5) 


Xn AX) 





and f(x) = O(g(x)) as x — a if there is a neighbourhood U(a) at whose all 
points, except possibly at the point a, the ratio f (x){p(x) is bounded. We can 
also consider the cases when x approaches a only from the left (x < a) or 
only from the right (x > a); for the point at infinity we must then write 
X ++ œ in the former case and x — — eo in the latter. Obviously, in these 
cases by a neighbourhood of a we mean its corresponding one-sided (i.e. a 
left-hand or a right-hand) neighbourhood. Finally, we can also include the 
cases when x in (3) and (4) tends to a finite or an infinite limit running through 
a definite sequence of values xi, x», ... 

It is evident that if f(x) = o(q(x)) (x -- a) and (x) = o(p(x)) (x - a) 
then f(x) = o(y(x)) (x + 4) since 

f») = e(x) p(x) = elx) eio) p(x) = ex) p(x) 


where ea(x) = e(x) ex(x) + 0 (x — 4) because e(x) — O and ei(x) — 0. 
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Examples 

L x" = ole) (x ++), (n = 1, 2, 3,...). 
2. x = o{x) (x = 0). 

3. x = a(x’) (x =œ). 

4. In x = o(x) (x — + æ). 


5. x = O(sin x) (x ~ 0). 


Two functions f(x) and f(x) are said to be equivalent (or asymptotically 
equal) for x + a if both functions are defined and different from zero in a 
neighbourhood of the point a, except possibly at the point a itself, and if 


. JI) 1. 
imr (6) 


For equivalent functions we shall write 
Six) = fx) (xa) 


Here the condition that x tends to a can also be understood as was mentioned 
above (i.e. in the sense of one-sided limits). 





Theorem 1. For two functions fi(x) and f(x) defined on E to be equivalent 
(asymptotically equal) for x — a (x € E) it is necessary and sufficient that the 
conditions 


Ais) = fax) o(faG) (+ aand f(x) & 0. (x sa) (7) 


hold. 
Proof. It follows from (6) that 





rs =1+ex) — (e(x) + 0, x a) 
whence 
Six) = fox) + (x) fax) = fo(x)+0(fo(x)) — (x a) 
that is (7) holds. l 


Conversely, let (7) take place. Then fi(x) = fo(x)+ (x) /2(x) where 
£x) > 0 (x ~ a) whence 

Jio. 

fex) 


Now, passing to the limit as x — a we arrive at (6). 
Note that if fi(x) = f(x) (x — a) then we also obviously have f(x) a: f(x) 
(x - a). 


= l+e(x) 


Theorem 2. Let there be a neighbourhood of a at whose all points, except 
possibly at the point a itself, three functions f(x), fo(x), and A(x) are defined. 
If fi(x) = f(x) for x > a then 


lim (AA) = lim (4692 409) (8) 
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This equality should be understood in the sense that if the limit on its 
right-hand side exists then the limit on its left-hand side also exists and coin- 
cides with the former, and vice versa. 

It follows that if one of the limits does not exist the other does not exist 
either. 

Proof. Let the limit on the left-hand side of (8) exist and be equal to A. Then 
obviously 


lim {fu(x) 469) = lim x» lim [ADA = 1-4 = A 





The existence of the limit on the right-hand side of (8) and its equality to the 
limit on the left-hand side, provided that the latter exists, are proved anal- 
ogously. 

The theorem we have proved is quite simple but is very important. Its 
practical application requires the knowledge of as many pairs of equivalent 
functions as possible. 

Below are some examples of this kind. 

sin x 





(i) sin x ~ x (x — 0) because lim sem l. 
x-—U z, 
z 1 : 
(i) 1—cos x = a (x > 0) since 
2 sin? Š 2 (3) 
TER x : 2 : 2 o] 
lir int = lim --—;—— -lim—-——- > 
x-o  * x—0 m x20 X = 


The second equality in this chain holds on the basis of Theorem 2 and due 
to the fact that sin x/2 ~ x/2 (x — 0). 
(iii) e^ — 1 xh (h — 0) since if we put e^—1 =z then e" = 1+z, 
h = in (1+2) and 
1 


lim E lim -— -—— = lim l = =i: 
heo È zo In(l+z) 2p (In (lz) Ine 





I 
‘In a ~ ine 
Inu for u > 0 and, in particular, for u = e. 
(iv) In (1--u) ~ u (u — 0). Indeed, 
li In s +u) 
im 


The equality lim 7 = 1 holds because of the continuity of 


= lim In (1+)*" = Ine = 1 
u-0 u-Ü0 
nO .. 
(v) Vitu-l = = (u > 0), z = 1,2, ... Indeed, taking into account that 
the function (1 +u} is continuous at the point u = 0 we can write 


ETES u 


‘ Se ee | (u — 0) 


x LL ray Vin (p Iano Vh e Lu, 1] 
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(vi) tan Vee N (x <P: 0) since 
` t . i X 
] t li (= X . 1 ) j 


saoo X x-0 ' X  COSX 








because cos x is a continuous function. 
As an instance, consider the following example involving (ii), (v) and 
Theorem 2: 


x: 
3 


3 —— 


yiti- E e 
Um Te eos 8 ay = lhm- cee (9) 
2 


The following definition is also of use. If for a function (x) there are 
numbers x = 0 and m such that g(x) ~ ex", x — 0, we say that the function 
ex" is the principal (power) asymptotic term of the function p(x) (for x > 0). 

The right-hand members of asymptotic equalities (1)-(vi) are obviously the 
principal: (asy mptotic) terms of their left-hand members. The general methods 
of determining principal terms in more complicated cases are based on the 
application of Taylor's formula (see $ 5.11, Examples 4.5, and § 5.14). 

If ax and px” (x, B = 0) are respectively the principal terms of some 
functions « and v, Theorem 2 indicates that 





a 

£o B 
im 2 tin JF (10) 
so VX) z-o BX 90 for mn 

ec for man 


Above we used this general property in the special case of the computation 
of limit (9). 


CHAPTER 5 


Differential Calculus. Functions 
of One Variable 


§ 5.1. Derivative 


Before proceeding to study the present chapter it is advisable to reread 
3 1.5 where the notion of the derivative was discussed. Here we beein with 
the formal definition of the derivative. ` 

The derivative of a function f at a point x is the limit to which tends the ratio 
of the increment y of the function at that point to the corresponding incre- 
ment dx of the argument as “Ix tends to zero: 





J'(x) = lim 2. = lim fuese fug (1) 


Ax+0 ax D Ax 


lt should be noted that for any fixed x the ratio 2v is a definite function of 


Ix: 


wx) = E 

If the given function fis defined in a neighbourhood of the given point x, 
the function »(-Jx) is defined for all sufficiently small 1x distinct from zero, 
that is for 4x satisfying an inequality 0 < | Ax: < 6 where ô isa sufficiently 
small positive number. For Ax = 0 it is not of course defined. The question 
of the existence of the derivative of the function fat the point x is equivalent 
to the question of the existence of the limit of the function (Ax) at the point 
Ax = 0. 

‘Theorem 1. /f a function f possesses the derivative f’ at a point x it is con- 
tinuous at that point. 

Proof. 'The existence of the finite limit (1) implies that 


Ay pL Ay 
Fe HL Otel) 
where (dx) — 0 as Ax - 0. It follows that 

Ay = P'a) Axt elix) ax = f(x) Axt o(aly) (4x + 0) 
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whence 
lim Ay =0 
Ax—-0 
The latter relation means that the function fis continuous at the point x. 
The converse of Theorem 1 is not true: a function f continuous at a 
point x may have no derivative at that point (see the discussion below). 
We say that f has an infinite derivative at a point x equal to + œ orto — œ 


(the case œ is excluded) if, respectively, we have f'(x) = lim z mw 
Ax 0 


or f'(x) = lim L= = — œ at the point x. 
àx-—0 
Finally, we introduce the notions of the right-hand and left-hand deriva- 


tives of f at a point x which are, respectively, uo by the relations 


fi) = lim 2 = g(0--0) and f(x) = lim Æ = y(0—0) 
dee d co 


The right-hand and left-hand derivatives are also termed one-sided deriva- 
lives. 

For the derivative f'(x) to exist it is obviously necessary and sufficient that 
the right-hand and left-hand derivatives of f at the point x should exist and be 
equal to each other; then the value of each of them automatically coincides 
with f '(x). 

This assertion continues to hold if “derivative” is replaced by "infinite 
derivative". 

The function whose graph is shown in Fig. 5.1a possesses the derivative at 
the point xo since at this point the graph has a (uniquely determined) tangent 





(c) M 


(e) (f) 
Fig. 5.i 
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line. The function shown in Fig. 5.15 has no derivative at xo but the deriv- 
atives f,(xo) and ^ (xo) exist and are different from each other. The func- 
tions in Figs. 5.1c and d have, respectively, the infinite derivatives f'(xo) = 
= + œ and f'(xo) = — œ while the functions in Figs 5.le and f have no 
derivatives at the point xo. In the case shown in Fig. 5.le we have f^ (xo) = 
= + e and f(x) = — œ and in the case of Fig. 5.1f we have f (xo) = 
= — e and fí(xo) = + œ. 

It should be stressed that the derivative of a function f at x is a (new) 
function of x. Therefore the symbol f'(x) is convenient for the notation of the 
derivative as function of x while f'(a) denotes a concrete number equal to the 
value of the derivative of the function fat the point a. 

In § 1.5 we derived formulas (1)-(4) for the derivatives of x" (n = 0, 1, .. .), 
sin x and cos x. Below we demonstrate the computation of the derivative of 
the exponential function a* (a > 0): 

a 


. Pra : 1 F 
a^) = lim = lima: za lim -————-- 
( ) h—9 h tO z—0Ü log, (I +z) 


E aco. b o ee de 
^ ^7 Tim jog, (1+z)"* ^ log,e 
z= 0 


z 








=a*Ina (2) 


Here we have used the substitution a^— 1 = z — O(h — 0) and the fact 
that the function log, is continu- 
ous for u > 0 and, in particular, for 
uc e. 

Putting a — e in (2) we obtain 





(ey = e* (X 
Let us consider the function 
i x forx=0 
y,= |x| = A 2 
-xX orx< ò 
(see Fig. 5.2). For x = 0 we have Fig. 5.2 


Ay lOth- _ lal 1 forh>0,4 +0 
Ax h h —1 forh=<0,h—0 
The derivative of | x| at the point x = 0 does not exist since the right-hand 


and left-hand derivatives at this point are different; at all the remaining 


points the derivative of | x] exists and is expressed by the formula 
+1 for x > 0 

|x|’ = sgn x = 
—1 for x «0 


The graph of the function | x| clearly shows that this function is continuous 
for any x and, in particular, at the point x = 0 as well. This is also seen from 
20006—9 
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the following calculations: 
\|x+h|—|x|] <|xt+h—-x]=|h]| +0 — (h-0) 


The function | x| gives us an example of a function continuous at a point 
and having no derivative at that point, namely, it has no derivative at the 
point x = 0 but is continuous at it. The graph of this function has no (defi- 
nite) tangent line at the point x = 0. This example shows that the converse of 
Theorem 1 does not hold. 

In mathematics there are examples of functions f continuous throughout 
a closed interval [a, b] and having no derivative at every point of the inter- 
val (a well-known example of such a function was constructed by K.T.W. 
Weierstrass). The graphs of such functions cannot be plotted in an ordinary 
way but the functions themselves can be represented by certain formulas 
which we do not give here. 


Example 1. The function Pd by the formula 
for rational x 
f(x) = ane 
for irrational x 
is discontinuous at all points x ~ 0 while at the point x = 0 it possesses the 


derivative {’(0) = 0 because we have ———,;—— Z- FO) =% - = 0 for rational h 


and Aw o = - = h ~ 0 for irrational h tending to zero. 


Example 2. The function 
fx sin l forx #0 
0 forx = 0 


is continuous on(— œ, o») and has the derivative for all x + 0; atthe point 
x = Oit even has neither the cie nor the left-hand derivative since 


LO LO) si = has no limit ash tends to zero retaining 


f(x) = 


the expression 


positive or negative values. 

If two functions u(x) and v(x) possess derivatives at a point x, their sum, 
difference, product and quotient (in the last case it is additionally supposed 
that v(x) # 0) also possess derivatives; these derivatives are expressed by 
the formulas 





(utoy =w +v (4) 
(uv) = uv'4-u'v (5) 

and ] OS 
(z) = M (v T 0) (6) 


The proof of (4) was presented in Chapter 1, § 5. Let us derive (5) and (6). 
If the independent variable x is given an increment Ax the functions u and v 


DIFFERENTIAL CALCULUS. FUNCTIONS OF ONE VARIABLE 131 


gain the corresponding increments Zu and Av. Now we write 


(uv) — lim Av) = lim et A) anuo l| 


d4x—0 4x0 
. Av : Au 4 
= lim u= + lim v——+4 lim & Av = yo'+ ow' 
z=: = uv'+ ou 
dxo AX ggg Ae aug Ax ^ 


since the existence of the derivative of v implies that the function v is con- 
tinuous, that is Jv — 0 for Ax + 0. 


In particular, if u = C where C is a constant we obtain (Cuy = Cu'+ 
t C'u = Cw because C’ = 0. 
Formula (6) is obtained as follows: 





. dn av 
(E) = tim 3. (24) = tim “BO lorum 
axo Ax \0t4v ov} ` wao vtd — v 


Some Basic Differentiation Formulas 


besote. condo 


A more general formula is 


1y — x rey —nx"^! n T a 
GJ = GN ae ea 





x" 
Thus, there holds the formula 
(x^) = nx"! (n=0, £1, 42...) (7) 


generalizing formula (1) in § 1.5 to the case of any integral n. 
As will be shown, formula (7) continues to hold for nonintegral values of n 
as well. 


2. (tan x)! = (xy = cos x(sin x)' — sin x(cos xy n 





COS x, cos? x z 
cos x cos x— sin x(— sin x 1 
= = (= x) = D 2 sec? x '(8) 
cos? x cos? x 
3 (cot x} = (ce zy .. sin x(cos x) —cos x(sin x) _ 
li i sin x sin? x 
— sin? x —cos? x 
zI——————— = — esc? 9 
sin? x dd (9) 


§ 5.2. Differential of a Function 
If a function f(x) has the derivative f'(x) at a point x there exists the 
limit 


lim Z=) A o fec) -SO 


dx—0 
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It follows that 
D Sfax) (dx +0) 


where e(Ax) -- 0 as Ax — 0. Hence 
Ay = f'(x) Ax-F e(Ax) Ax, e(Ax) — 0 for dx + 0 (1) 


that is 
Ay = f'(x) 4x+ 0(Ax) (Ax = 0) (1^) 
Denoting A = f'(x) we rewrite equality (1) as 
Ay = AAx+o(4x) (4x +0) (2) 


A function f is said to be differentiable at a point x if its increment Ay 
at that point can be represented in form (2) where A is a constant independent 
of Ax (but, generally, dependent on x). 

From the above it follows that if a function f(x) has the derivative f'(x) 
at a point x it is differentiable at that point and A = f'(x). 

The converse also holds: if a function f is differentiable at a point x, that 
is if its increment at the point x is representable in form (2), it possesses the 
derivative at the point x equal to the number A. 

Indeed, let the increment Ay at the point x be representable as (2). Dividing 
both members of (2) by 4x and passing to the limit we obtain 

f'G) = A+ lim 9. = A+ lim o(1) = A 
Ax—>0 4x— 0 

Thus, for a function f(x) to have the derivative f'(x) at a point x it is neces- 
sary and sufficient for it to be differentiable at that point. 

Equality (2) shows that if A = f'(x) z 0, the increment of the function 
is equivalent to the first term on the right-hand side of (2) for Ax — 0: 


‘Ay = AAx c (4x + 0) 


In this case (when A + 0) the term A Ax is called the principal linear part 
of the increment. The principal part depends on 4x linearly (more precisely, 
it is directly proportional to Ax). Approximately, discarding the infinitesimal 
of higher order o(Ax), we can put Ay equal to the principal part for small 
values of Ax. 

The principal linear part of the increment is called the differential of the 
function f, at the point x, corresponding to the given increment 4x of the 
independent variable x and is denoted as 


dy = df = f'(x) Ax 


For the sake of the symmetry of the notation the increment 4x of the 
independent variable is also denoted as dx and called the differential of x; 
we thus put, by definition, 4x = dx. This convention does not contradict 
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the expression dx = x' Ax = Ax of the differential of the function x = x 
dependent on the argument x. 
pg Thus, the differential of the function fat the point x is written as 


dy = f'(x) dx (3) 


It follows from this equality that the derivative f'(x) of f(x) at the point x 
is equal to r , that is it is equal to the ratio of the differential of the function 
fat the point x to the corresponding differential of the independent variable x. 

It should be noted that the differential dx of the independent variable is 
independent of x and is equal to Ax, i.e. to an arbitrary increment of the argu- 
ment x. As to the differential dy of the function y (different from y = x), 
it depends both on x and on dx (see (3)). 





Fig. 5.3 


The notions we have discussed can be given a simple geometrical inter- 
pretation. Consider the graph of the function y — f(x) shown in Fig. 5.3; 
the points A and B of the graph correspond to the values x and x-- Ax 
of the independent variable. The ordinates of the points A and B are re- 
spectively equal to f(x) and f(x+ 4x). The increment of the function at the 
point x is equal to Ay = f(x-4- Ax) — f(x) and is represented by the length 
of the line segment BD; the latter can be written as the sum Jy = BD = 
= DC+CB where DC = tana Ax = f'(x) Ax and « is the angle between 
the tangent to the graph at the point A and the positive direction of the 
x-axis. 

As is seen, the line segment DC is the differential of the function fat the 
point x: 

DC = dy = f'(x) 4x 
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Thus, the second term CB entering into the expression of the increment 
Ay is equal to the quantity o(4x). The latter can even be greater than the 
principal part of the increment for large Ax but if Ax — 0 it becomes an 
infinitesimal of higher order of smallness relative to Ax. If f'(x) = O then 
for any € > 0 there is 6 > O such that the inequality CB/DC < e holds for 
all Ax satisfying the inequality |4x| < à. 

Below are some evident formulas: 


d(utv) = (uXvy dx = w dxtv' dx = duc dv (4) 
d(uv) = (uv) dx = (uv'+u'v) dx = u do-4- v du (5) 
and 
4 du — 
d(=) = (=) de= v note (6) 


Example. Let it be required to estimate the amount of the material needed 
for manufacturing a cubic box if it is known that the internal edge of the 
box is of 10 cm and that the width of its walls is of 0.1 cm. 

The volume of a cube with edge a is expressed by the function V(a) = a’. 
The volume of the material needed for the walls of the box is expressed 
approximately by the increment of this function: 


AV = V(10--0.1) — V(10) ~ V'(10)-0.1 = [322], 40.1 = 
= 300-0.1 = 30 (cm) 


§ 5.3. Derivative of Composite Function 


Theorem. Let z = F(x) = f(g(x)) be a function of a function where y = g(x) 
and z = f(y), and let the function q have the derivative p'(x) at a point x and 
the function f have the derivative f'(y) with respect to y at the point y = g(x). 
Then the derivative of F at the point x exists and is expressed as* 


F'(x) = f'0)'09 (1) 


Proof. Since the function ọ has the derivative g’ at the point x it is differ- ` 
entiable at this point (see the foregoing section), that is, for sufficiently 
small 4x we have 


Ay = g'(x) Ax+e(4x) dx —— (e(Ax) + 0 for Ax + 0) (2) 


Similarly, the existence of the derivative of f at the point v implies, for 
sufficiently small Ay, the relation 


Az = f(y) Myt+ex(4y) dy  (e(4y) + 0, Ay -- 0) (3) 
If we put £:(0) = 0 equality (3) continues to hold for Jy = 0 as well. 


* Formula (1) expresses the so-called chain rule for differentiation. — Tr. 
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Therefore for sufficiently small Ax and, consequently, for sufficiently small 
Ay we have 


Az = f'g (x) Ax+f'(y) e(Ax) Ax4- Ay e(Ay) 

(2 > y, Ax > 0) 
On dividing both members of this equality by Ax and passing to the limit as 
Ax + 0 we receive F'(x) = f'(y)p'(x) because Ax — 0 implies Jy + 0 
(see (2)); then (see (3)) we also have ex(4ly) — 0. The reason why the con- 
vention €1(0) = 0 has been stipulated is that there can be cases when Ay = 0 
for some 4x = 0. 

Formula (1) can be extended to the more general case of a composite 
function formed of more than two constituent functions. For instance, if 
z= f(y), y = p(x) and x = ($) and if all the three functions have deriv- 
atives at the corresponding points we have z; = z;y;x:. 


Example. To compute the derivative of the function z — cos (sin? x?) 
with respect to the variable x we introduce the chain of auxiliary functions 


Z = cosu, u = 2, v=sinw and wx 
Now we can write 
dz . E 
"x = (cos uy (v? (sin w)' (2Y = — sin u (3v?) cos w-2x = 
= — 6x cos x? sin? x? sin (sin? x?) 


The functions 











A e o Ee ee 
sinh x — * 5, cosh x= E, 
2 2 
sinh cosh x 
tanh x = me coth x = — 
cosh x sinh x 


are respectively called the hyperbolic sine, cosine, tangent and cotangent. 
^"We obviously have 





(sinh x = 4 (e+e) = cosh x (4) 
(cosh x)’ = 4 (ee) = sinh x (5) 
a, — cosh x(sinh x)’—sinh x(cosh x) __ (cosh x)'—(sinh x)? _ i 
(tanh xy = ————“coshx  - (cosh x)? ~~ (cosh x)? 
(6) 
"" pot. (tanhx y — — — 1! (cosh xy? O — 1 — 
(coth x)’ = (Sars) = tanh) (cosh x (sinh x)? ^ ^ (sinh xy 


(7) 
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Alternative Proof of the Theorem. Let us consider a sequence of values of 
Ax tending to zero (Ax — 0). If the values 4y corresponding to these 4x’s 
are different from zero then 


E Az ; dz dy; ' 
lim -= = lim (FZZ = By, 
bic Ax axo NÀY ax) Ms 


If to the values of 4x entering into the sequence in question there corre- 
spond Jy = 0 we have Az = 0 and 


lim E e lim Dez k 
x0 4x Axo AX de: 


The last equality holds since in this case we necessarily have y; = 0. 
Now, if the sequence of values 4x -- 0 is arbitrary we can always split 


it into two sequences of the above two types. The limit Pa (4x — 0) exists 


and is equal to zy; for both of the subsequences. Therefore the limit Z 
also exists for the entire sequence and is obviously equal to z,y; (see § 4.1, 


Theorem 9). 


§ 5.4. Derivative of Inverse Function 


Let a strictly monotone (that is a strictly increasing or strictly decreasing) 
function y = f(x) be defined on an interval (a, b). If an interval (A, B) is 
the image of (a, b) (corresponding to this function), the inverse function 
x = g(y) of the function f exists and is defined on (A, B); it is one-valued, 
continuous and strictly monotone (see $ 4.5). 

If x € (a, b) is fixed and then is given an increment Ax (x+Ax c (a, b) 
the function f receives the corresponding increment Ay (y, y+Ay € (A, B) 
such that y-- Ay = f(x+ Ax). ' 

Conversely, p(y + Ay) = x+ Ax. 

By the continuity of the given function and its inverse function the follow- 
ing assertion holds for the indicated Ax and Ay: Ax — 0 implies Ay — 0 
and vice versa. 

Now, let the function v have a nonzero derivative p'(y) at the point y. 
We shall show that in this case the function f also has the derivative f’ at 
the corresponding point x. Indeed, 


xd. 
áx ^ dx 
ay 
and, since Ax — 0 implies Ay — 0, we have 
li 4y 1 1 
im -= = ——- = 


dx—0 dx lim Ax p(y) 
Ag -- 0 AY 
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We thus receive 


SY) = v0) (1) 
or, equivalently, 
dy "en 1 , 
TOR (1) 
dy 


We have proved that if y — f(x) is a strictly monotone continuous function 
and x = (y) is its inverse function possessing the derivative p(y) # 0 at a 
point y then the function f possesses at the corresponding point x the derivative 
specified by formula (1). 

It may turn out that lim T = eo at the point y. In this case the function 

4y—0 
f obviously has the derivative f'(x) = 0 at the point x. 
If lim x o we have Ax O for the strictly increasing function and 
ayo AY Ay 
= < 0 for the strictly decreasing function. In the former case f'(x) = + © 
and in the latter f'(x) = — æ. 

Derivative of log, x. On the basis of what has been proved, putting 

y = log, x we get 
1 l = 1 __ log, e 


(log, x)' = (wy ^ wina xia x 








(a > 0) 
For the natural logarithm the derivative is expressed particularly simply: 
(2d 
(In x)’ = — 


This formula accounts for the fact that in mathematical analysis, at least in 
theoretical studies, it is preferable to deal with the logarithrnic function to 
the base e. 

The function In x = log, x is defined as a real function only for positive 
values of x.* 

The function Jn |x| can of course be considered both for positive and 
negative values of x. Its graph is symmetric about the y-axis and coincides 
with the graph of In x for positive x (Fig. 5.4). 

The function In |x| plays an important role in the integral calculus. For 
x s* O its derivative is given by the formula 

1 


f 1 
(In [x]) SUD SERE mr (x # 0) 


* For negative values of x the function In x can also be derived in a natural way as a 
complex function. Here we shall not discuss these questions. 
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Fig. 5.4 
where 
1 for x > 0 
sen x = 
—] forx «0 


(In connection with the function y = In |x] see the second example in the 
table of indefinite integrals given in $ 8.1.) 

For the derivative of the power function x" (x > 0) where 7 is an arbitrary 
real number we now obtain the formula 


(xy = (e"!n xy’ = le lax — nx^7i (8) 


generalizing formula (1) in § 5 of Chapter 1. 


Derivatives of Inverse Trigonometric Functions. The function y = arcsin x 
is strictly increasing on the closed interval [— 1, +1] and maps this interval 
on the closed interval [—s¢/2, 2/2]. Its inverse function x = sin y has the 
derivative (sin y)' = cosy different from zero within the open interval 
(—s¢/2, 72/2). Therefore 

1 1 1 


: 1 
‘= = = ————— = — 1 l 
(arcsin x) Ginyy 08) yi yF (—1 <x =< 1) 














Consequently, 
(arccos x)' = (S -arcsin x) = = (-1<x<1}) 


2 =x 








Here we take the arithmetic root (with the sign “+ ”). 

The function y = arctan x is strictly increasing throughout the real axis 
(— œ, +œ) and maps it onto the open interval ( —7:/2, z[2). Its inverse 
function x = tan y has the derivative (tan y)’ = sec? y different from zero 
on that interval. Therefore 

1 ey EM 
~ T+tan?y 14x 
= (log, ay 
xina * 








(tan yy sec? y (eedem) 


(arctan x)’ = 





Exercise. Prove the equality (log, a)’ = 
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§ 5.5. Table of the Derivatives of the Basic 
Elementary Functions 














(C) =0 (C is a constant); (cos x)' = —sin x; 
(xy = x1 (n = 0, £1, £2,...); (tan x)’ = sec? x; 
(ay = Ina-a* (a > 0); (cot x)’ = —csc?x 
(e) =e; (arcsin x)’ = - I =; 
(xo) = ax@-1 (x > 0); } 1—-x* 
1 
4 l a . 1 = ? 
(log, xy = MA (x = 0, a 0); (arccos x) fics 
1 
(n3' =} (x>0); arctan) e 
TE 1 (x 4 0); (sinh x)’ = coh x; 
x . (cosh x)’ = sinh x; 
(s Smee 1 for x > 0; j i -» 
Em 1 for x «0; Ganka) = {cosh x)?” 
(sin x) =cosx; (coth xy -2- ny i 
Exercises 


Prove that* 


2ax+b 


1. I fac bx tel = ECCE 


2. Zin (x-- Yat x2) = aS » 
1 - " 
p^ ; 


3. (arcsin zy =: 
x aj. 


(the upper sign corresponds to x > 0 and 





4. (arcsin J F 
. x 
the lower to x < 0). 
5. (ey = (etary = x* (1--In x). 


Xe 


6. (In [tan x] = 


xl 1 
whence (In tan il = dux 





sin x cos x 
7. = (arcsin = += y= x" 2ya-x. 
; x|?^?x for x # 0 
8. (Ixte = {Pll 
0 for x = Owhere p > 1. 


* Formulas 1-7 are of use for the computation of indefinite integrals. 
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§ 5.6. Derivatives and Differentials of Higher Orders 


The derivative of a function f is a new function of the same argument. 
Therefore we can try to find its derivative. The resultant function (provided 
it exists) is called the second derivative of f(x) and is denoted as f” (x). Thus, 


L" = FQ)’ 


By induction, the derivative {*(x) of the nth order (or, simply, the nth 
derivative) is defined as the (first) derivative of the derivative f^^ (x) of the 
(n — D)th order: 


fx) = ( f "7 »()y 


Of course, the nth derivative of a given function fat a given point x may 
or may not exist. 

If a function fis said to possess the nth derivative at a point x it is meant 
that it possesses the derivative f^^? (x) of the (n— I)th order in at least a 
sufficiently small neighbourhood of the point x and that this derivative 
itself has the derivative at the point x. It is the latter derivative that is denoted 
f(x) and is called the derivative of the nth order, or the nth derivative, 
of f at the point x. 

The function x" where m is a positive integer possesses the derivatives 
of any order throughout the real axis: 


(x7) = m(m— 1) Biase (m—n4-1) xmn 


For n > m we have (x) = 0. 

The power function x? where a is an arbitrary real number possesses for 
x > 0 the derivative of any order n which is determined by the analogous 
formula 


(x2) = a(a—1) ... (a—n4- 1) xe7^ .. (1) 
Obviously, 
(a*) = (In a)" a* (—9 < x< æ) (2) 
and, in particular, 
(e = ex (=œ < x< æ) (3) 
It is also easy to verify the formulas 
(sin x)? = sin (x7) (n= 1,2, ...) (4) 
and 
(cos x)? = cos (x+n 5) (5) 


Ifs = f(t)is a function expressing the dependence of the path travelled by 
a point in a rectilinear motion on time 7, the second derivative s” = f"'(1) 
is the acceleration of the moving point at time moment ¢. As will be seen, 
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the second derivative of a function is extremely important for the study of 
the geometrical properties of the graph of the function. 


Leibniz Formula. If we take a function of the form f = uo where u and v 
are certain functions possessing the nth derivatives at a given point, the nth 
derivative of f exists at that point and is expressed by the Leibniz formula 


LO = uv (i) uo» () ued., My = 


= y (7) uO yla-D (6) 


l=0 
n 2 E H 
where ( A are the binomial coefficients and u = u (see § 5.9, formulas (6) 
and (7)). 
The formula is proved by induction. It evidently holds for n = 1. If we 
suppose that it holds for n, its validity for n+ 1 is proved as follows: 


d n . n 
one £ $ (nenne $ ymo = 
f=0 f=0 


atl 


Ey (, 2j AD yorr1-D a y (4) yD yati- = 
i21 i i=0 d 
ntl 


Eee 


Here we have used the relations ("*!) = (") = (" 
UC 


Example. 
(x sin x)@° = x sin (x+ 100 5) +100-1-sin (x+ 99 5) = xsin x— 100 cos x 


I! 


(ni) = Land 


Let us consider a function y = f(x) defined on an interval (a, b). There is 
an infinite number of ways in which it can be represented as °° 


y = P(x) —f(x) (x€ (a, b)) (7) 


In the considerations below we use the following terminology for such a rep- 
resentation: the variable y is a function o = f (x)) of the independent variable 
x; this same variable y is a function of the dependent variable u (y = q(w), 
u # x). The latter variable depends on the independent variable x (u = y(x)). 
Thus, the variable x plays an exceptional role here: in all the considerations it 
only enters as an independent variable: 


The differential 
dy = f'(x) dx (8 


* A simple derivation of Newton's binomial formula based on the differentiation 
formula (x*)' = ux*^! for natural n is presented in $ 5.9, Example 1. 
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of the function f will also be called she first differential of f, at the point x, 
corresponding to the differential (increment) dx = Ax of the independent 
variable x. 

The nth differential (the differential of the nth order) of the function f, at the 
point x, corresponding to the differential dx = Ax of the independent variable 
x is defined by induction: 


d'y = ddy) = d(fO-%x) dx?) = f(x) dx" (9) 


Hence, the differentials d and d*—1 in these equalities are taken for one and 
the same differential dx, of the independent variable x, which is regarded as 
a constant quantity (independent of x). 

It follows from equality (9) that the nth derivative of f at the point x is 
equal to the ratio of d'y to (dx)": 


FOR) = zT. (10) 


where the expression d^y in the numerator is the nth differential of y (at the 
point x) corresponding to the value of dx in the denominator. 

Now let us regard the variable y as a function of the dependent variable u 
(u = x), that is y = g(u) and u = w(x), where y and y possess a sufficient 
number of derivatives. Then 


dy = f'(x) dx = q'(u) (x) dx = o'(u) du (11) 


We have thus expressed the first differential dy in terms of u. 

Equality (11) describes a remarkable property of the (first) differential. 
Namely, the differential dy was defined originally as the product of the deri- 
vative of y with respect to the independent variable x by the differential dx. 
It now turns out that, according to (11), the differential dy can also be defined 
as the product of the derivative of y with respect to the dependent variable u 
by the differential du, and there hold the equalities 


dy = y, dx = y, du (12) 


. provided that the differential du in the third term of (12) corresponds to 
that very dx which enters into the second term of (12). 

To express the meaning of (11) ((12)) we say that the form dy = g'(u) du 
in which the first differential is written is invariant with respect to any variable 
u. It turns out that for differentials of the second and higher orders the in- 
variance property no longer holds in the general case. More precisely, if 
n> landu # x then, generally, d'y is not equal to p(x) du", in contrast 
to the case when u = x is an independent variable. 

Indeed, we have 


Py = d(dy) = d(g'(u) du) = dp'(u) du-- p'(u) Pu = 
= g" (u) (du) 9'(u) Pu (13) 
Here d?u # 0, and therefore the term g'(u) d?u cannot be discarded since 
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du = (x) (dx). Thus, the second differential, in contrast to the first 
differential, is not invariant in the above sense. 

The same situation (the absence of the invariance) occurs in the case of 
higher-order differentials. For instance, 


By = d(d*y) = g” (u) (duy +g" (u) d(duy*--9(u) du d*u--9'(u) Pu = 
= g'"(u) (duy +p" (u) 2du d*u 4-9" (u) du d*u4-g'(u) Pu = 
= g'"(u) (duy + 3e" (u) du Pu+o'(u) du (14) 


The differentials of the fourth, fifth, etc. orders are computed in the same 
manner. As 71 grows the expression of d"y becomes more and still more comp- 
licated. 

Let y be a function of u where u is a dependent variable, that is u, in its 
turn, is a function of a third variable x. We may not express the latter de- 
pendence explicitly. Moreover, the precise dependence may be unknown and 
we may only suppose that such a dependence does in fact exist. Under these 
assumptions we shall compute the derivatives of y with respect to u: y», Yu's 
Yu's e 

As is already known, 


r dy 
y= > (15) 


that is the derivative of y with respect to the variable u is equal to the ratio of 
the corresponding differentials: y; = dy: du. 

In the computation of higer-order derivatives we use the above rule for 
the first derivative and the rules for the computation of the differentials of 
sums, differences, products and quotients (see § 5.2, formulas (4), (5) and (6). 
We should also take into account that d'y = d(d"—1y). 

Following this course we find the second derivative: 


«(2) 
wv du] _ 1 dud'y-dyd'u _ dud*y—dy du 





" ^ — du du du? du? (16) 


The left member of (16)'is the second derivative of y with respect to u while 
the right member is a definite rational expression containing the differentials 
du, dy, @u and d?y. If u = x, thatisif uisan independent variable, we have 
2. 
du = dx # 0 and du = 0; in this case (16) implies the equality yẹ = E 


already known. But if u is a function of x distinct from x then y,’ should be 
computed by formula (16). 


We similarly find 
du d?y — dy d*u 
tr a ( du? ) 
Ja = == — oe R 


... du*(d*u d*y+du d?y — dy d*u— dy d*u)— (du dèy —dy d'u) 3dw? d'u (17) 
ue du? 
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Supplementary Remark. The derivative ae an even function is an odd function: 
" im Loca MAE) ag LER a fe). 
fCc3-1 ae = lim -r 


Analogously, the derivative of an odd function is an even function. It follows 
that the derivative of order k of an even function is an even or an odd func- 
tion depending on whether k is even or odd. 


§ 5.7. Increase and Decrease of a Function 
onan Interval and at a Point. Local Extremum 


A function f is said to be strictly increasing on an open interval (a, b) (or on 
a closed interval [a, b]) if, given any two points x; and x» belonging to (a, b) 
(or to [a, b]) and satisfying the inequality x; < x», the inequality f (x1) < 
< f(x») holds. 

A function f is said to be nondecreasing on (a, b) (or on [a, b]) if x1, x» € 
€ (a, b) (or x1, x» € [a, b]) and x1 < xs imply f(x1) = f(x»). 

Similarly, a function f is said to be strictly decreasing ( nonincreasing) on 
(a, b) or on [a,b] if x1 < x» and xı, x» € (a, b) or xı, x» € [a, b] imply 
f Ga) > f(x) (f 60) = fe). 

Let a function f be defined in a neighbourhood of a point x. Then the 


expression 
Ay = f(x Ax)- f(x) 


of its increment at the point x makes sense for all sufficiently small Ax. 
By definition, we say that the function 
(i) increases at the point x if there is 6 > O such that 


a y 
A-0 (0< |4x| < ò) (1) 
(ii) decreases at the s x if there is 6 > O such that 
T <0 (0 < |Ax| < ô) (2) 
(iii) attains a local maximum at the point x if there is ô > 0 such that 
4y<0 —(ldx| < ô) (3) 
(iv) attains a local minimum at the point x if there is 6 > 0 such that 
4y 20 (|4x| = 6) (4) 


It should be stressed that all the inequalities (1)-(4) must hold for all 
positive and negative values of 4x which are sufficiently small in their abso- 
lute values. 

The above four properties can also be expressed as follows: for all the 
points x’ € (x—4, x) and for all the points x” € (x, x+ ô) the relations 


SE < f(x) «fo 
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and 
fox) > fX) > f(x") 


hold, respectively, in the first and second cases, and for all the points x' € 
€ (x— 8, x+ à) the relations 


F(x’) « f(x) 
and 


fx) = f(x) 


hold, respectively, in the third and fourth cases. Thus, in Case (iii) the value of 
fat the point x is its maximum yalue in a sufficiently small neighbourhood of x 
and in Case (iv) the value of fat the point x is its minimum yalue in a suffici- 
ently small neighbourhood of x. 

Local maxima and minima are called /ocal extrema. 

We shall be interested in the problem of finding out which of the above 
four cases takes place provided that the derivatives of f of the first and higher 
orders are known at the point x or in the vicinity of x. 

Suppose that the function f has the derivative f’ at the point x which is 


positive: lim e» e f(x) > 0. This means that the ratio Ay/4x, which is a 
4x—0 


function of Ax for the fixed value of x, tends to a positive number. Therefore 
(see Theorem 2 in § 4.1) this ratio itself must be positive for all 4x satisfying 
the inequality |Ax| = ô for a sufficiently small 6; hence, according to Defi- 
nition (i), the function f increases at the point x. 

It is similarly proved that if f'(x) < 0 then the function f decreases at the 
point x. We have thus proved the following theorem: 


Theorem. If a function f(x) has the positive derivative f’(x) — 0 (the nega- 
tive derivative f'(x) < 0) at a point x it increases (decreases) at that point. 
This theorem immediately implies l 


Fermat's Theorem. If a function f attains a local extremum (a local maxi- 
mum or a local minimum) at a point x and if the derivative f'(x) exists at this 
point it is equal to zero: f'(x) = 0. 

Indeed, if f'(x) + O then, by the foregoing theorem, the function in- 
creases or decreases at the point x and therefore the extremum of the func- 
tion cannot be attained at that point. 

This theorem can be restated as follows. 

For a function f possessing the derivative at a point x to attain a local extre- 
mum at this point it is necessary that the derivative of f at the point x be equal 
to zero. 

The condition f'(x) = 0 is not of course sufficient for the function f to 
attain a local extremum at the point x. If f'(x) = 0 the function f may have 
no local extremum at x. It can increase at that point (for instance, this is the 
case for the function x? at the point x — 0) or decrease (which is the case for 
the function f(x) — —x? at the point x = 0); moreover, the point x may 


20006— 10 
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neither be a point of increase or decrease nor a point of extremum. The last 
possibility is clearly demonstrated by the example of the function 


2 sinl ; 
Jis fx sin — forx #0 (5) 


forx=0 


It has the derivative /'(0) = 0 because 
lim f- £0" £0) _ 


: lim —— feo) = lim ae Oil = lim x sin I =0 


x—Uu x0 x—0 E x—0 


(since |sin = EN < 1). On the other hand, in any neighbourhood |x| < 4 of the 


point 0, however small, the function f assumes positive and negative values 
both to the right and to the left of the point x = 0. Therefore the point 0 is 
neither a point of increase or decrease nor the point of extremum of the 
function f. 

In the next section we shall present some extremely important theorems 
known as the mean-value theorems (or laws of means) for derivatives. Later on 
hey will bc conveniently applied to the study of local extrema. 


8 5.8. Mean-value Theorems for Derivatives. 
Tests for Increase and Decrease of a Function 
on an Interval. Sufficient Tests for Local Extrema 


Rolle’s* Theorem. Let a function f be continuous on a closed interval [a, b], 
have the derivative in the open interval (a, b) and assume equal values at the 
end points (f(a) = f(b)). 

Then there is at least one point c belonging to the open interval (a, b) at 
which the derivative of f turns into zero (f'(c) — 0). 

Proof. Let M and m be, respectively, the maximum and the minimum 
values of f on the interval [a, b]. They are sure to exist since the function f is 
continuous on [a, b]. If the equalities M = m = f(a) hold then f(x) = 
for all x € [a, b] and f'(c) = 0 at any point c € (a, b). If these equalities do 
not hold simultaneously then at least onc of the numbers M and m is distinct 
from the number f(a) = f(b); for definiteness, let M = f(a) = f(b). This 
means that the maximum value of the function f is attained on the closed 
interval [a, b] at a point c belonging to the open interval (a, b), and conse- 
quently f has a local maximum at that point. Since the derivative /‘(c) of f at 
the point c exists, Fermat's theorem implies that it is equal to zero. The case 
m +Æ f (a) is treated analogously. 

The theorem has been proved. 


* M. Rolle (1652-1719), a French mathematician who was the first to prove this 
theorem but only for polynomials. 
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Cauchy's Mean-value Theorem". Let two functions (x) and w(x) be con- 
tinuous on a closed interval [a, b] and possess the derivatives within the open 
interval (a, b) which do not turn to zero simultaneously. Also let ¢(b) —q(a) # 
z 0**. 

Then there is a point c belonging to the open interval (a, b) at which the 
equality 

w(b)-v(a) — v'(c) : 1 
gib)-e(a) ^ (c) PY) (1) 








holds. 
Proof. Consider the auxiliary function 


F(x) = ph) -e e) — [7)-9@] 4) 


Obviously, it is continuous on [a, 5] and has the derivative on the interval 
(a, b). Besides, F(a) — F(b). Therefore, by Rolle's theorem, there is a point 
c € (a, b) such that F'(c) = 0, that is 


lb) —e(a)] v'(c) = [v(5) —w(2)] v' (o) Q) 


There must be q'(c) z 0 because, if otherwise, there would be y'(c) = 0 
since g(b) —g(a) = 0 while, by the hypothesis, p’(c) and y'(c) do not vanish 
simultaneously. Therefore the product [g(5b)—g(a)] y'(c) is different from 
zero. On dividing the left-hand and right-hand members of (2) by this pro- 
duct we arrive at (1). 

Putting q(x) = x we obtain, as a consequence of Cauchy's theorem, 
Lagrange's theorem. 


Lagrange's*** Mean-value Theorem. Le! a function g(x) be continuous on a 
closed interval [a, b] and possess the derivative on the open interval (a, b). 
Then there is a point c belonging to the interval (a, b) such that the equality 


q(b)—q(a) = (b—a)g'(c) | (a-c- b) (3) 
holds. 
Lagrange's theorem admits of a simple geometrical interpretation. Let us 
write it as 
b m " 
2-20 — p'e) 


hag (a<c <b) 


The left member of this equality is the tangent of the angle of inclination of 
the chord, subtending the arc of the graph of the function y = g(x) with end 
points (a, p(a)) and (b, g(b)), to the x-axis; the right member is equal to the 
tangent of the angle of inclination of the tangent line to the graph drawn 


* This theorem is also called the second mean-value theorem or the double law of the 
mean; sometimes it is referred to as the generalized (or extended) mean-value theorem, the 
latter name not being commonly used. — Tr. 

** It should be noted that if, for instance, we introduced the condition g'(x) = 0 
on (a, b) this would imply g(5)— g(a) = 0. 

*** J. L. Lagrange (1736-1813), a famous French mathematician, 


ice 
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through the point with an inter- 
mediate abscissa c€ (a, b). Lag- 
range’s theorem thus means that if a 
curve (see Fig. 5.5) is the graph ofa 
continuous function defined on 
[a, b] and having the derivative on 
(a, b) then there is a point on the 
curve corresponding to an abscissa 
c(a<c < b) such that the tangent 
line to the curve at this point is 
parallel to the chord joining the end 
points (a, p(a)) and (b, p(b)) of the 
Fig. 5.5 curve. 

Equality (3) is called Lagrange's 
formula of finite increments. The intermediate value c can be conveniently 
written as 





c = a4 0(b —a) 


where 0 is a number satisfying the inequalities 0 < 9 < 1. Then Lagrange's 
formula turns into 


p(b)—9(a) = (b-a)g'(a-0(b-a) (0< 6 — 1) (4) 
It obviously holds not only for a < b but also for a= b. 

Theorem 1. If a function is continuous on a closed interval (a, b] and has a 
nonnegative ( positive) derivative on the open interval (a, b) it is nondecreasing 
(strictly increasing) on [a, b]. 

Indeed, let a = xı < xs = b; then the conditions of Lagrange’s theorem 


are fulfilled for the closed interval [x1, x2] and therefore there is a point c 
belonging to the open interval (x1, x2) such that 


F(x- f(xi) = (xa—x)f'(c) "^ (x1 =c < x2) 
If f’ = 0 on (a, b) then f’(c) = 0 and 


f —f 03) $0 (5) 
If f’ > 0 on (a, b) then f’(c) > 0 and 
I(%2)—f(x1) > 0 (6) 


Inequalities (5) and (6) holding for any xı and xz such that a = x, < xs = b, 
the function f is nondecreasing on the interval [a, b] in the first case and 
strictly increasing on the interval [a, b] in the second case. 


Theorem 2. If a function has a derivative identically equal to zero in an 
interval (a, b) the function is constant on (a, b). 
Indeed, by Lagrange's theorem, we have 


S-S) = (6-21) f(e) 
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where x, 1s a fixed point of the interval (a, b), x is the variable point (which 
can be to the right or to the left of xi) and cis a point lying between x1 and 
x whose location is dependent on x, and x. By the hypothesis, f'(x) = 0 on 
(a, b), and therefore we have f’(c) = 0; hence f (x) = f(x1) = C = const 
for all x € (a, b). 

It should be noted that the condi- 
tions imposed on the functions in 
these theorems cannot be weakened 
because this may lead to the failure 
of the assertions ofthe theorems. 

For instance, the function f(x) 
specified by the equalities 


= x for Ox fe) i 1 x 
1-x for x < 1 Fig. 5.6 


(see Fig. 5.6) is obviously continuous on the interval [0, 1], takes on zero 
values at its end points and has the derivative at all the points of (0, 1) 


except at the single point x = 5 >it is readily seen that neither Rolle's 


theorem nor Lagrange’s theorem any longer hold for this function. 


Now we proceed to a theorem providing some sufficient criterion for the 
existence of a local extremum of a function. 


Theorem 3. Let a function f be continuous in a neighbourhood of a point 
xo and have the derivative f'(x) in this neighbourhood. If - . 


f(x) = 0 («0) to the right of xo 
and 


f'G)-0(—0) tothe left of xa 


then xo is a point of local minimum (maximum) of f. f 

The expression “to the right (to the left) of xy" should be understood.here 
in the sense “on a sufficiently small open interval with left (right)end point 
xo”. The proof of the theorem is a direct consequence of the formula of 
finite increments 


Af = f(x) —f (xo) = (x— xo) f (xo-- 8(x— xo)) 


because the conditions of the theorem imply that the right-hand side of the 
formula is nonnegative (nonpositive) in a sufficiently small neighbourhood 
of the point xo irrespective of the sign of the difference x— xo. 

Note that the existence of the derivative at the point xo itself is not sup- 
posed in this theorem. Of course, if the derivative f'(xo) exists then, by 
Fermat's theorem, it is equal to zero. 

The following theorem provides a sufficient test for the existence of a 
local extremum using the sign of the second derivative. 
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Theorem 4. Jf a function f satisfies the conditions f'(xo) = O and f" (xo) > 0 
(f""(xo) < 0) then xo is a point of local minimum (maximum) of the function f. 

Proof. The existence of the second derivative at the point xo implies the 
existence of the first derivative f'(x) in a neighbourhood of the point xo 
and, of course, the continuity of f in this neighbourhood. The condition 
f" (xo) > 0 (< 0) means that f'(x) increases (decreases) at the point xo 
and, since f'(xo) = 0, we have f’ < 0 (> 0) to the left of xo and f' — 0 
(< 0) to the right of xo. The assertion of the theorem now follows from the 
foregoing theorem. 

As is known, a function continuous on a closed interval [a, b] and having 
a positive derivative throughout the open interval (a, b) is strictly increasing 
on [a, b]. On the other hand, in the example presented below we have a func- 
tion f which is continuous in a neighbourhood of the point x — 0 and has 
the positive derivative f/'(0) > O at that point but at the same time is not 
increasing in any neighbourhood of x — 0, however small. 

Thus, gencrally, the increase of a function at a point does not imply its 
increase in a neighbourhood of that point. 


Example 1. The function F(x) = LM (x) where fis defined by equality 
(5) in the foregoing section has the derivative P'(0) = 7./'(0) = = > 0 


at the point x = 0 and consequently it increases at that point. At the same 
time the function is not increasing in any interval containing this point. 
Indeed, for x # 0 we have 


F(x) = 4—cos < 42x sin L 


If x, = 1/kr (k = 1,2, ...) then 
Fx) = -(71Y 


whence we see that any interval enveloping the origin contains points at 
which the derivative F’ assumes values of different signs and consequently 
F is not monotone on such an interval. 


Example 2. Consider the function 
x In |x| for x #0 
x)= 
909 { for x = 0 
Let us regard it as being defined on the closed interval [— 1, e]. The function 
is continuous and has a finite derivative throughout [— 1, e] except at 
x = 0 where T 
'(0) = lim 2 = lim In |h] 2— e 
y'(0) = lim 26579) = lim In th (7) 
It follows from (7) that p decreases at the point x = 0. The equation 
p(x) = 14+1n |x] = 0 has two roots: xı =—I1fe and x» = lje. We also 
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have w'(x) = 1/x (x # 0), v"(—1/e) <0 and y"(1/e) — 0; consequently 
— l/e is a point of local maximum and 1/e a point of local minimum. 
Example 3. The graph of the function 
Ü—a 
= - b?—4ac <0, c>0 
7 b+2tVc ( Vd AL 
(see § 8.9) splits into two continuous branches corresponding respectively 
to the variation of t within the intervals (— ©, —b/2 yc) and (—5/2 yc, œ). 
On each of the intervals the function is monotone and increases from — e 
to + c». This can readily be seen if we take into account that the condition 
b*—4ac <0 implies that x’ — O0 and that (¢?—a) = Z-a <0 for t= 


=—b/2ye. j 





8 5.9. Taylor's* Formula 


Taylor's formula which we study in this section makes it possible to 
determine approximately, sometimes with a high accuracy, the values of a 
given function f in a neighbourhood of a point a from the given values 
f(a), f'(a), ..., f"79(a) of the function f and its derivatives up to order 
n— 1 inclusive at that point a and from some information on the values of 
the nth derivative /*? in this neighbourhood. 

To this end some special approximating polynomials known as Taylor's 
polynomials of the given function are constructed from the given values of the 
function and its derivatives. 

We shall begin with the derivation of Taylor's formula for an arbitrary 
polynomial 

P(x) = bot bixt ... +5,x" (1) 


: Let us choose an arbitrary number a and replace x by (x—a)+a in the 
right-hand side of equality (1): - > 


P(x) = bo+bi[(x—@)+a]+ ... +5,[(x—a)+a]" 


On opening the square brackets and combining similar terms containing 
the same powers of x—a we obtain the equality 


P(x) = Bo+Bi(x—a)-+ ... +Ba(x—ay" = Y Bx-a* D 
k=0 


where fj are constants dependent on the original coefficients bx. 

Equality (2) is called the expansion of the polynomial P(x) in powers of 
x— a and the numbers f), are she coefficients of this expansion. 

The original equality (1) can be interpreted, from this point of view, as 
the expansion of P(x) in powers of x, that is in powers of the difference 
x—a with a = 0. 


* B. Taylor (1685-1731), an English mathematician. 
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Let us differentiate in succession equality (2): 
P'(x) = Bit+2Bo(x—a)+ 38s(x—a)?-+ 
P"(x) = 2824+-3-283(x—a)+4-38a(x—a)?+ 


P(x) = k1B,-- (k- D& ... 2Beai(x—a)t+... 


Putting x — a in the last equality specifying the kth derivative we see 
that all the terms on the right-hand side, beginning with the second, tum 
into zero, and we thus obtain P“(a) = k!fy (k = 0, 1,2, ...). Here, as 
usual, we put Pa) = P(a) and 0! = 1. Thus, the coefficients f, of ex- 
pansion (2) of the polynomial P(x) in powers of x—a are necessarily ex- 
pressed by the formulas 


B. re (k = 0,1,2,...) (3) 





In particular, it follows ek one and the same polynomial P(x) of degree 
n can be represented as an expansion in powers of x—a in a unique way, that 
is if 


P(x) = Y Bix-af*— Y pix- a) 
k=0 koO 


for all the values of x where fj, and fj, are constants then 
Bk = Br (A = 0,1, ...,”) 
since both numbers fJ, and fj; are expressed by the same formulas (3). 
Thus, 


PE) = P+O 


4 220 


n! 


E 1o (x—ay-. 





(x—a)y = 





(zs 
.y 2 Pc -ay (4 


k=0 
Formula (4) is called Taylor's formula, in powers of x—a, for the given 
polynomial P(x) of the nth degree or, simply, Taylor’s formula for P(x) at the 








point a. 
Taylor’s formula in powers of x, that is the representation 
n PEO 
P(x) = y A (5) 


is also called Maclaurin’s* formula. 
Example 1. Newton's binomial formula. Let us consider the polynomial 


P(x) = (at xy 


of the nth degree where a is an arbitrary number and n is a natural number. 


* C. Maclaurin (1698-1746), a Scotch mathematician. The name "Maclaurin's for- 
mula" is commonly used but is historically incorrect. — 7r. 
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The kth derivative of the polynomial is 

PG(x) = n(n— 1) corer (1—k4- 1) (a+ xy'7* 
whence P(0) = n(n— 1) .. . (n— k-4- 1)a"7*; consequently, bv Maclaurin’s 
formula, we have PT 


ue 1) nn- 2 Um (n— 2) 


(a4- xy = a" + na” lyp qn735 x+ I — cM q" AyD NETS 
n(n—1). i i 
toi ee (6) 
Equality (6) is known as Newton's binomial formula. 
Denoting 
ny — n(n-10)...(n- A10) mo qm 
ue oam s gren g 
we can rewrite Newton’s binomial formula in a more compact form: 
? n 
(a4- xy = 5 (arto (6^) 
k=0 


The numbers (c) are called binomial coefficients. 


If we multiply both the numerator and the denominator of the fraction 
in (7) by (n— k)! we obtain 


(7) _ n(n-1) ... (n—k-D(in-&)...1 
k] Kk! (n— Kk)! 


n ni ' 
(2) = agr (k = 0,1,2,...) (T) 


The case k — 0 is also embraced by this formula since 0! — 1. 
Another important property of binomial coefficients is expressed by the 


formula 
(si) 5 (G3) 


whose proof is left to the reader. Using the last equality and taking into 


account that (o) = = 1 we can compute in succession the numbers 


(t) for any n and k using only the operation of addition. 


Above we have derived Taylor's formula for polynomials. Now we shall 
generalize it to the case of an arbitrary function f defined in a neighbourhood 
of a point a; the function f may not be a polynomial but is supposed to 
possess the derivatives up to order n inclusive in this neighbourhood". 


* The considerations in this section require in fact less restrictive conditions on f (sce 
the statement of Theorem 1 below). 
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Let us compute the numbers f(a), f'(a), ..., f(a) and use them to 
construct the function 


(n— 1) 
Q(x) = f(a)+ FO .— a+... HL a (x-a = 





n-i Bg 
= T FP (ay (8) 


Obviously, Q is a polynomial of degree not higher than n—1. It is called 
Taylor’s polynomial or, more precisely, Taylor’s polynomial of degree (n—1) 
for the function f at the point a. 

If the original function f itself is a polynomial of the (n— 1)th degree then, 
as was shown, we have the identity /(x) = Q(x) for all the values of x 
belonging to the neighbourhood in question. But in the case under con- 
sideration the identity may fail to hold since, by the hypothesis, the function 
f may not be a polynomial of degree n— 1. But nevertheless the polynomial 
Q turns out to be closely related to f in its properties. Indeed, representing 
the polynomial Q by Taylor's s we obtain 


o) = F 229 29 (xa) (9) 


k=0 


Since (8) and (9) are expansions of one and the same polynomial in powers 
of x—a we must have 


f(a) = Qa) (k = 0, l, ...,n— 1) (10) 


Hence, Taylor's polynomial of the (n— 1)th degree for function f can also 
be defined as a polynomial of degree (n— 1) such that the » equalities (10) 
hold for it. 


M yon 2. In Fig. 5.7 we see a curve representing the graph of a function 

= f(x). As a zeroth approximation to this curve in the vicinity of the 
boit à — 0 we can naturally take the graph of Taylor's polynomial of 
zeroth degree. for. the. function. f(x); 
this polynomial y = Qo(x) = f (0) = 
= const represents the straight line 
y = f (0) parallel to the x-axis. As a 
first approximation to the given curve 
it appears natural to take its tangent 
line at the point x — 0. The equation 
of the tangent is y = Qi(x) where 
Qi(x) = f(0)+f'(0)x. The next (second) 
approximation computed in this man- 
ner is y — 25 where Q»(x) = f(0)4- 


+f" (0)x+ (0 x2. This is Taylor’s po- 
lynomial of dene 2 for f at the point 
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x = a = Q, that is a polynomial of the second degree such that its value at 
the point O and the values of its derivatives of the first and second orders 
at that point coincide respectively with /(0), /’(0) and /"'(0). 

We see that, at least in a sufficiently small neighbourhood of a = 0, 
the graphs of the subsequent Taylor polynomials of the function f at the 
point 0 become closer and still closer to the graph of f as their degree in- 
creases provided that the function is differentiable at the point a = 0a 
sufficiently large number of times. 


Let us put 
f(x) = Qn-1(x) + R(x) (11) 
where Q,-1 is Taylor's polynomial of degree n— 1 for the function f at the 
point x = a. 


Equality (11) is called Taylor’s formula for the function f in the neighbour- 
hood of the point a (or simply, Taylor's formula for f at the point a), and 
R,{x) is called the remainder term or the nth remainder of Taylor's formula. 

It is remarkable that the remainder can be expressed in terms of the nth 
derivative of f. In this section we shall derive two such expressions, namely 
Lagrange's form and Cauchy's form of the remainder. 

The remainder of Taylor's formula in Lagrange's form is written as 


R(x) = EL ep, EE (a,x) 


where £ is a point belonging to the interval (a, x) (and dependent on x and 
n). The value of x in this formula can be not only greater than a but also 
smaller than a*. The exact value of £ is usually unknown and the only 
information is that & lies somewhere in the interval (a, x). 

It is also convenient to represent the number £ as E = a-4-0(x— a) where 0 
is a number satisfying the inequality 0 < 6 < 1. Then Lagrange's form of 
the remainder becomes 


R(x) = E2 foa+6(x—a)), ^ 00-1 


The expression of the remainder of Taylor's formula in Cauchy's form is 
written SUM MOI aee 


R(x) = €-9 C D fata), 0<6<1 


where 6 is a number dependent on x and n. 

Note that in the case n = 1 Taylor's formula for a function f(x) with the 
remainder in Lagrange's (or Cauchy's) form turns into Lagrange's formula 
of finite increments established in § 5.8: 


f()-f(a) = (x-a)f'(a-09(x—a), | 0«0«1 


The theorem on the remainder reads: 


. *Ifx-« a then (a, x) and (a, x] denote, respectively, the sets of points t satisfying the 
inequalities x < t < a and x «t «a. 
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Theorem 1. Let a function f be continuous on a closed interval [a, x] together 
with its derivatives up to order n— 1 inclusive and let the nth derivative of f exist 
in the open interval (a, x). 

Then the nth remainder for Taylor's formula can be written in Lagrange's 
Jorm and in Cauchy's form. 

Proof. Let us set an arbitrary number x belonging to the interval indicated 
in the statement of the theorem and also an arbitrary natural number p. 
The number x will remain unchanged in the course of the proof. For our 
aims it will be convenient to introduce a new auxiliary variable u relative 
to which x will be regarded as a constant. 

Our purpose is to find a convenient expression for the remainder R,,(x) 
in Taylor's formula 

n-i (x- ay 
f= Y, ETM SAER) 
k=0 
We shall find R,(x), that is the value of the remainder at the point x. To this 
end we represent R,(x) as the product R,(x) = (x—a)? H; the problem is 
thus reduced to determining the quantity H. The quantity H depends on x 
and, according to the hypothesis, it will be regarded as constant. 
Hence, we proceed from the equality 
n-1 (x- ay 
f() 9 y €x - f9a) cca» H 


k-0 
Now we formally replace the constant a entering into the right member of 
this equality by the variable u. This leads to the function 


n-1l 


(y) = y, Cc poms (xu) H = 
0 


(x—uy^! 
(n— 1)! 


il 


f) fe... feu)-(x—u)H (12) 
which. is defined for at least all the values of u belonging to the interval 
[a, x] and is continuous for these values of u since the original function f(u) is 
continuous on that interval together with its derivatives up to the order n— 1 
inclusive. The definition of the function d(u) implies that for u = ait assumes 
the value f(x) (d(a) = f(x)) and for u = x it turns into f(x) ($(x) = f(x). 
which immediately follows from the expression on the right-hand side of 
(12). Indeed, if we put u = x in this expression, all the terms beginning with 
the second vanish while the first term turns into f(x). Finally, the function 
(u) possesses the derivative in the interval (a, x) because the original func- 
tion f has the nth derivative in that interval. 

We see that the auxiliary function ®(u) satisfies the conditions of Rolle's 
theorem: it is continuous on the closed interval [a, x], is differentiable on the 
open interval (a, x) and assumes equal values at its end points. Therefore, by 
Rolle's theorem, there is an intermediate point u = a+ 6(x— a) lying between 
a and x and such that the derivative d* is equal to zero at it. 


DIFFERENTIAL CALCULUS. FUNCTIONS OF ONE VARIABLE 157 


Let us compute this derivative: 
D'u) = f'(u) — f'(u)3- (x—1) f" ()— 1) fF ... 


n-e? = yrl 
LI pe LEB foga 
All the terms in this expression, except the last two summands, cancel out. 
If the indicated value u = a+6(x—a) is substituted into the remaining terms 
their sum, as was said, turns into zero. 

This results in an equation in the unknown H. On finding H from this 
equation and multiplying it by (x— a)? we arrive at the expression for the 
remainder": 

(x— ay n— n 
R,(x) = ip (1—0 -r F(a+ 0(x— a)) 

Here R,(x) depends on p where p can be any natural number. Putting 
p = n we obtain Lagrange’s form of the remainder and putting p = 1 we 
obtain Cauchy’s form. 

In the case a = 0 Taylor’s formula is also called Maclaurin’s formula 
which has the form 


fo- » LAO sh + Ral) (13) 


where the remainder is written as 


R,(x) = = f(6x) 


in Lagrange’s form and as 


Rx) = x 0.—8)7 (0x) 

in Cauchy's form. 

Now let us suppose that the function f has the continuous rth derivative 
f A(x) at the point a. This means that there is a neighbourhood of the point 
a in which the function f has the derivative f% and therefore has the con- 
tinuous derivative {“—). Hencethe conditions for the expansion of the func- 
tion f by formula (11) with the remainder in Lagrange's form are fulfilled in 
this case, and taking into account the continuity of /“ at the point x = a 
we can write 


Rx) = EX fat (x—a)) =" pa) prx) — (4) 
where 
a(x) = E= [foa4-6(—a))—f9(a)] = 
= (x—ay o(1) = o((x—a)") (x + a) 


* This expression is known as Schlómilch's form of the remainder. O.X. Schlómilch 
(1823-1901), a German mathematician. — Tr. 
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Consequently, 


n (9) 
fx) = y f atto((x—ay)) (x a) (15) 
k=0 
Expansion (15) is termed Taylor's formula for the function f at the 
point a with remainder in Peano's* form. The result we have obtained can be 
stated as 


Theorem 2. Jf a function f possesses the continuous derivative of order n at 
a point a it is representable by Taylor's formula (15) at the point a with remain- 
der in Peano's form. 

Now we shall prove the following lemma. 


Lemma. The equality 
aot ai(x—a)+ ... e, (x—a)y'4-o((x—ay) = a+ 
+ aj(x—a)+ ... +0,(x—a)"+0((x—a)"), x-a (16) 
where o, and a; are constant numbers independent of x implies that 
EE (k = 0,1, ...,n) (17) 
Indeed, passing to the limit as x — a in the right-hand and left-hand sides 


of (16) we obtain the equality xo = a. On deleting the terms with «o and 
«y and cancelling (16) by x—a we arrive at the equality 


a+ &o(x—a)+ ... Fa, (x—ay- t--o((x—ay-!) = a; + 
+ e(x—a) ... t e;(x—ay-*--o((x—ay-7!) 
whence, on passing to the limit as x — a, we obtain x; = «1. Proceeding in 
this way we arrive at (17), and the lemma has thus been proved. 
This lemma and what was said above imply the uniqueness of the expansion 
of the function f by Taylor's formula with remainder in Peano's form. 'This 


must be understood in the following sense. If a function f possessing the 
continuous nth derivative at a point x — a is representable in the form 


f(x) = «odoi(x—a)4- ... Fo (x—ay t o((x—ay), xa (18) 


where «45 are constant numbers then these numbers are uniquely determined 


by the formulas 


(E) 
a, = LO, k=1,...,7 


that is (18) is nothing but the expansion of f(x) by Taylor's formula with 
remainder in Peano's form. 

Taylor's formula at the point x = O for an even (odd) function f only 
involves terms containing even ( odd) powers of x: 


f(x) = ae asx?-F aax*--. ..., 
(S(x) = aye ag ...) 


* G. Peano (1858-1932), an Italian mathematician. 
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This follows from the fact that the derivatives of odd orders of an even 
function and the derivatives of even orders of an odd function are themselves 
odd functions (see the end of § 5.6) and, since these derivatives are supposed 
to be continuous at the point x = 0, they necessarily vanish at that point. 

In particular, it follows from the last assertion that for a polynomial 


P(x) = y au xh 
9 


to be even (odd), that is to be an even (odd) function, it is necessary and 
sufficient that all its terms involve x only in even (odd) powers. 


Example 3. From the equality 1--x?4- ... x?" = (1— x?7n*5/(1— x?) 
and from the fact that x?"*?/(] — x?) = o(x?") (x — 0) it follows that 


m 
]-ax* 


-]d4xtM ... H o(x?m) (x — 0) (19) 


Therefore (19) is nothing but Maclaurin's formula for the function (1— x?)7! 
with remainder in Peano's form. 


§ 5.10. Taylor's Formula for Most Important 
Elementary Functions 


The Function f(x) = e". For this function we have 
FON) = er, FO) =1, fOO=e* (x=0,1,2,...) 


Therefore Taylor’s formula in powers of x (Maclaurin’s formula) for 
the function e* with remainder in "E pum is written as 


= Lt SH Ht e ctgepgp A 


tut 
RO) te (0<6<1). 


Putting x = l in it we obtain the following approximation to the number 
e: i 
abr 
(1— 1)! 
The error of this approximation is estimated by the inequality | R,(1)| = 
zm E e < — 

n!’ 
For any x = 0 we have 


exltlt+a+ e.t 


IRO) s e0 (n=) 
and for x < 0 we have 


R(x)! <P (n — œ) 


160 A COURSE OF MATHEMATICAL ANALYSIS 


The Function f (x) = sin x. In this case we have 
f(x) — sin (425). SO = sin — 


and 
nm 


SOMOx) = sin (0x4) — (W=1,2,...) 


Taylor’s formula in powers of x with remainder in Lagrange’s form for the 
function sin x is thus written 


3 
sin x = S .+(— Iy*'1 ER Wa) 


i 
Roy 4 (X) = dum sin (0x+ (2v+1) e" 
The remainder tends to zero as v + e» for any x: 
Set 
IR) eO (re) 
The Function f (x) = cos x. For this function 
f(x) = cos (T). f (0) = cos = 
and 

SOx) = cos (ox +) (n= 1,2,...) 


In this case Taylor’s formula in powers of x with remainder in Lagrange’s 
form is 


2 yd Xp 
cos x = art at ... +(= 1) 1 decr Rule) 


R2,(x) = eu cos (6-272) 
The remainder behaves like in the case of sin x: 


IR EE o (ye) 


The remainders in Taylor’s formulas for the functions sin xand cos x tend 
to zero particularly fast when |x| = 1. It should be added that for practical 
computations it is sufficient to know the values of these functions for the 


arcs x lying within the limits from 0 to + <]. 





The Function f(x) = In (1+x). This function is defined and infinitely 
differentiable for x >—1. Hence, Taylor's formula can be written for this 
function for any n = 1, 2, ... and x — — 1. Since 


fex) = Ce , FXO = (—1y71 (n—1)! 
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Taylor’s formula is 
In(14-3) = x— T... (-1y 


x" 
n— 





1 
7+ Ri) 
The remainder can be taken both in Lagrange’s form 


(-1)) n 
R(x) = Aras (0<@ <1) 


and in Cauchy’s form 


_ á x? 1—-0^-1 
R, = (- 1) TI 140x (rs) (0 <9 < 1) 


Let O = x = 1; then using Lagrange's form we obtain | R,(x)| = L x" +0 


(n — =). We see that for 0 - x —« 1 the remainder tends to zero fast 
while for x = 1 it tends to zero very slowly. 

In the case —1 < x < 0 Lagrange’s form does not provide any informa- 
tion on the rate at which R, tends to zero because we only know that 0 
satisfies the inequalities 0 < 0 < 1, and one should bear in mind that 0 
depends on both x and n. But if we apply Cauchy’s form we obtain the 
estimation 





|Rnl < m —-0 (n+) 
: : 1-8 1-6 
for the remainder valid for 0 < |x| < 1 because tes C8 1. 
For x =—1 the expression In (1-- x) loses sense. When x — 1 Taylor's 


formula makes sense for any n but its remainder R,(x) no longer tends to 
Zero as n — co. This can be shown with the aid of the following artificial 
technique*. Let us put 





| S0) = x- £4 ... H E 
Then 
Sn(x)+ Ra(x) = Sn41()+ Ras) 
and 


R,(x)— Ra41(x) = (-—1)"*2 = 


For x > 1 and n + œ the right-hand member of this equality does not 
tend to zero. Therefore R,(x) cannot tend to zero for n — oo since the con- 
ditions of Cauchy's necessary and sufficient criterion for the existence of 
limit are violated here. 

Thus, the remainder in Taylor's formula for the function In (1-- x) in 
powers of x tends to zero as n - œ only when x satisfies the inequalities 
-l<xel. 


* This also follows from the divergence for |x| > 1 of the series with general term 
(7 1yx*-!/(n— 1) (see § 11.1). 


20006— 11 
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The Function f(x) = (1--x)". In this case 
f Xx) = m(m—1) ... (m-n4 1) (13- x77 
and 
LOO) = m(m—1) ... (m—-n4- 1) 
Taylor's expansion at the ue x = 0 takes the form 


(14-x" = 1H-mx 4-7 = E ES 


i ... (m—n+2) 
+ (n—1)1 
Lagrange’s form of the remainder in this formula is 


R, = m(m—1) am (m—n+1) 








x"-14 R(x) 


x"(1 + x)y"-" 


and Cauchy's form is 


_ mim-l1)...(m-n4l) ., 0 \r-1 
R= (n- 1)! DL (( Tra) 

For any natural m and any x all the terms of this formula beginning with 
the (m+1)th vanish and thus in this case Taylor's formula turns into 
Newton's binomial formula (see § 5.9, formula (6)). 

For all the other values of m the formula involves infinitely many nonzero 
terms; it makes sense at least for x — — 1. 

Let O« x <1. Then, using Lagrange’s form of the remainder, we 
obtain for n > m the inequality 

| Q9] <x Imm D mm eg (n — æ) 
(see the remark below). 

In the case —1 < x < 0 we make use of Cauchy's form of the remainder 

to obtain (see the remark below) 


IRI «C [m(m—1) ... (m—n4 1)| 


(— Di Ixi^—-0 (n=) 


where C is a number which in the general case depends on x but is indepen- 
dent of n since ((1— 0)/(14-0x))7! = ((1—6)/(1—0))"7! = 1 and 


(14-0x)"7! a 277! 


form— | > Oand 
1 


(1--0x)n^! < dCi 
form—1 <0. 


Thus, the remainder of Taylor's formula for the function"(1-- xy" tends 
to zero as n -œ for —1 <x < 1. For x > 1 the remainder no longer 
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tends to zero as n > oo” because if we denote by S,(x) the sum of the first 
n terms of the expansion of (1+ x)" we obtain (see the remark below) 


Ri(X)— Rng Cx) = Saoi(x)—S,(x) = mue map ius 
(n + œ) 
which shows that R,(x) does not satisfy the conditions of Cauchy's criterion 
for the existence of limit. 


Remark. The expression 


m(m—1) ... (m-nc1) xn 


Un = 
" n 


where 7 is an arbitrary real number satisfies the condition 


in m-n 
|l ER x| |x ne 





It follows (let the reader prove this) that 
u, ~ 0, if |x| <1 and u, + if |x| > 1 


(in this connection also see § 11.3, Theorem 2). 


§ 5.11. Taylor’s Series 


An expression 
Uot uit uz+uz+ ... (1) 


where ux are numbers dependent, in accordance with a certain law, on the 
natural index k (k = 0, 1, 2, ...), is called a (number) series. 


n—l 
Let S, = Y, uy denote the sum of its first n terms (itis called the nth 


o 
partial sum). The numbers S, form a sequence {S,} = (Si, $5, $5 ...}. 
If this sequence is convergent, that is if there exists a finite limit lim S, = S, 


n-eoo 
series (1) is said to be convergent and to have a sum equal to S. We then write 
S = Uot Ui Und .... 
If a function f is infinitely differentiable in a neighbourhood of a point 
à (i.c. it has derivatives of all orders) we can formally write for it the series 


f(a) LO (xa) 9 (x apa... Q 


called Taylor's series for the function f in powers of (x —a) (or Taylor's series 
for f at the point x — a). For given values of a and x it can be convergent 
or divergent. The case when Taylor's series of the function fis convergent 

* This also follows from the divergence for x > 1 of the series with the general term 


DOR D m nt ue ees 11.1). 
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to that very function is of particular importance; in this case the sum of the 
series is equal to f(x). 

Taylor's series is convergent to f if and only if the remainder in Taylor's 
formula 





fe = Y GP ote no) = S(x) + R(x) (3) 
tends to zero as n — œ. Indeed, if lim R,(x) = O0 then (3) implies 
lim S,(x) = f(x) 


and, since S,(x) is the sum of the first n terms of series (2), this series is 
convergent and has f(x) as its sum: 
ay 


$0) = f(a)4- L9 (x —.a) + LOR , (4) 
Conversely, if it is known that equality (4) is fulfilled for some value of x, 
that is if it is known that series (2) is convergent and has the number f(x) 
as its sum, this means that 


lim S,(x) = f(x) 


for the indicated value of x. Then (3) implies R,(x) > 0, n — œ. 
Now the results established in the foregoing section allow us to assert 
that the following Taylor series expansions take place: 


e-lpeRI A. (eere) 
sinx = x—2-+ 2 J 
cosx = 1-42- aS) 
i (5) 
(14x)? = Lem Mo) yay 
(MOOD sa (1 <x < 1) 
In(Lkx) e x— HT ee pre 


In these examples the sets E of points x on which Taylor's series in powers 
of x are convergent are intervals or half-intervals with centre at 0. As will 
be shown in$ 11.11, this fact reflects a general property of series of the form 


do-- dX 3- dax? 4- ... (6) 


where ax are some given constant numbers. It turns out that if such a series 
is convergent at a point x; it is sure to converge for all x satisfying the 
inequality |x] < |x;]. Series of type (6) are termed power series. 
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It may turn out that with a given function fwe can formally associate its 
Taylor series, at a point a, of the form 


(a) + L9 a) 09 Gaye... (7) 


(in other words, this means the derivatives (a) make sense for this func- 
tion for any k = 0, 1, 2,.. -) and that series (7) is convergent for some values 
of x but its sum is not equal to f(x). 


Example 1. An example of a function of the type mentioned above is 


elixt-l for |x| < 1 
w(x) = 8 
Ye) i for |x| = 1 e 


If |x| < 1 and if we put u = 1—x? then 
yp (x) 2 —2x(1—x7)7* euixt-1 — —2xu7? e7li" — 0, x-—0 
It is readily proved by induction that 
y (x) = P(x)(1—32)-1 eis = P(xu-lecM« = P(I)-0=0, x=] 


for k —0,1,2, ... where P(x) is a polynomial and the number / = 0 
depends on Kk. Since y(x) — O for |x| 2 1 we have thus shown that 
lim p(x) = 0. Further, we have »(1) = 0. If it is already known that 


x1 
y(1) = 0 for some k then 


E) k 
pI) = lim E7970 L fim y9(140(x—1)) 2 0 (0<0< 1) 
x—1 = x—l 

Thus, the derivatives (1), v'(1), y” (1), ... make sense for the function 
and, as has been proved by induction, they are numbers equal to zero. 
Therefore we can formally write Taylor’s series for this function at the 
point x = 1. All its terms are equal to zero for any x and thus it is con- 
vergent; its sum is equal to zero for any x andis distinct from p(x) for |x] = 1. 
A similar situation takes place in the case x =—1. 

The function y is an example of an infinitely differentiable function 
defined throughout the real axis which is equal to zero outside an interval 
(see $ 14.4). 

A function f(x) whose Taylor series in powers of (x— a) is convergent to 
f(x) in a neighbourhood of the point a is called an analytic function at all 
the points of this (open) neighbourhood. In particular, it is analytic at the 
point a. 

It follows that the functions e*, sin x and cos x are analytic throughout 
the real axis while the functions In (1-- x) and (1-4- x)" are analytic on the 
interval (— 1, +1). 

It can be shown (see Example 2 below) that the functions In (1-- x) and 
(1-- x)" can in fact be expanded into Taylor's series at any point a > 0; 
these series are convergent to the corresponding functions for sufficiently 
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small x—a whence it follows that the functions In (1+x) and (1+x)" are 
analytic for any x > 0. Analytic functions are studied in a special division 
of higher mathematics termed the theory of functions of a complex argument 
and also the theory of analytic functions. 

The functions defined on an interval can be classified as 

(i) arbitrary and, generally, discontinuous functions; 

(ii) continuous functions; 

(iii) functions having the derivative f? for some n = 1, 2, 3, ...; 

(iv) functions having the continuous derivative /€? for some n= 1, 


(v) infinitely differentiable functions, that is having the derivatives f? 
of any order and thus having the continuous derivatives f™ of any order; 

(vi) analytic functions. 

Each of these classes is contained in the preceding class and consists of 
functions “with a better behaviour”. 

The function specified by equalities (8) is infinitely differentiable on 
(— œ, œ) but is not analytic on this interval. By the way, at the same time 
it is analytic on (1, œ=), (— œ, — 1) and (— 1, 1). 

Example 2. Let Ai (x) = 1n x. Then f(x) = (—1)*1(k—1)! xt (x > 0; 
k= 1,2, ...) and 


In x = Ina} È pala R(x) 


where 
(-1y7! (x— a} 
` (a 9(x—a)yy? 


If |x—a] < a/2 then |a+6(x—a)| > RD > a—(a/2) = a]2, |(x—a)] 
(a+ 6(x—a))| < 1 and |R,(x)| = 1/n + 0. 
Thus, we have the expansion into the convergent series 


In x = Ina+7—*_ ge er t... 


R(x) = |x—al <a 


for any a > 0 and [x—a| < a[2. This shows that In x is an analytic function 
for any x > 0. 


Example 3. Let us write down the principal term of the expansion of the 
function 1n (1-- x 4-x?) in powers of x: 


In (1 4- x - x?) = (x4 x?) 4- o(x x) = x+0(x)+0(x) = x+0(x), x0 
Indeed, we have 1n (1+) = u+o(u) for u > 0, u = x+x? — 0 for x — 0, 
x? = o(x) for x -- 0 and o(x-- x?) = o(x) for x > 0, because cen = 


2 2 2 
= ecc) One. ox+x") _, 0 and t. — 0 for x — 0 and thus 
xtx x xxt x 
o(x4-x*) 
x 


— 0, x0 
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Example 4. Let us consider the same problem for the function 
In (1+x+22)—x 


The application of the foregoing result does not enable us to determine 
the principal term because this yields 


In (14+x+x?)—x = x+0(x)—x=o(x),, | x0 


But nevertheless we have obtained some useful information: if the principal 
term exists its degree is n > 1. Let us use Taylor's formula with theremainder 


o(u?), u — 0, in Peano's form. We have ln (14-1) = u— + oft), u-0 
and therefore - 


ats y 


In (1-x4x?)7-x = x4 x1— — + o((xx39)—x = 


- "e =F +o), x-0 


§ 5.12. Convexity of a Curve at a Point. 
Points of Inflection 


A curve y = f(x) is said to be convex upward (downward) at a point xo" 
if there is a neighbourhood of xo such that the tangent to the curve at the 
point xo (that is the tangent drawn through the point of the curve with 
abscissa xo) lies above (below) the points of the curve for all abscissas x 
belonging to that neighbourhood (see Fig. 5.8; in the figure the curve is 
convex downward at the point x1 and convex upward at the point xz). 

A point xo is called a point of inflection of the curve y = f(x) if the moving 
point of the curve having abscissa x passes from one side of the tangent 
(drawn through the point with abscissa xo) to the other as x increases and 


Oo Xi X4 X2 x 
Fig. 5.8 


* “Convex upward eso eM, is sometimes equivalently replaced by the expression 
“concave downward (upward)”. — Tr. 
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passes through the value xo (in Fig. 5.8 the point xs is a point of inflection). 
In other words, there exists a sufficiently small 6 > 0 such that the curve 
lies on one side of the tangent line at the point xo for all x € (xo— ô, xo) 
and on the other side for all x € (xo, Xo+ à). 

These definitions describe some characteristic elements of the behaviour 
of a curve in the sense of its disposition relative to the tangent line in a 
sufficiently small neighbourhood of the point of tangency. But it should be 
stressed that these definitions do not exhaust all the possible configurations 
of a curve and its tangent line. For instance, let us return to the function 


0 forx = 0 
I(x) = 


x sin = for x #0 


The x-axis intersects the graph of this function and is tangent to it at the 
point x = 0 but x = O is not a point of inflection. 


Theorem 1. [f a function f has the continuous second derivative f” at a 
point xo and f'"'(xo) > 0 (< 0) then the curve y = f(x) is convex downward 
(upward) at x. 

Proof. Let us represent f by Taylor's formula at the point x = xo: 


I(x) = f(x) - f'(xo) (x— xo) - R(X) 
R(x) = Gow "(x0+ 8(x — xo)) (0 «0 <1) 


The value of the remainder R(x) at a point x is equal to the elevation of the 
curve f over its tangent drawn through the point (xo, f(xo)). By the continu- 
ity of f”, we conclude that if f"(xo) > 0 then also f"'(xo4-0(x— xo)) > 0 
for all x belonging to a sufficiently small neighbourhood of the point xo 
and therefore we obviously have R(x) — 0 for any value of x different from 
xo and belonging to this neighbourhood. si 

The case f’’(xo) < 0 is considered similarly. 


Theorem 2. 7f a function f is such that the derivative f" is continuous at 
xo and f'"'(xo) = 0 while f'"(xo) = O then the curve y = f(x) has a point of 
inflection for x — xo. 

Proof. In this case we have 


f(x) = fxo)d-/'(xo) (x— xo) + R(x) 
R(x) = pr S” (xo4- 0(x— xo)) 


By the continuity of f’”’ at xo and by the fact that f""(xo) = 0, we conclude 
that f'"(xo-4-0(x— xo)) retains sign in a neighbourhood of the point xo 
(i.e. the sign is the same to the right and to the left of the point xo within 
this neighbourhood). On the other hand, the factor (x— xo)? changes sign 
as x passes through xo and, together with it, quantity R(x) (equal to the 
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elevation of the point of the curve over the tangent at xo) also changes sign. 
This completes the proof of the theorem. 
Now we state a more general theorem. 


Theorem 3. Let a function f possess the following properties: 
f" (xo) = ... = Ox) = 0 


S&*D(x) is continuous at xo and f **Y(xy) # 0. 

Then if k is an odd number the curve y — f(x) is convex upward or down- 
ward at xo depending on whether f **D(xy) < Q0 or f**U(xo) > 0; if k is an 
even number then xo is a point of inflection of the curve. 

If, in addition to the enumerated requirements, the function satisfies the 
condition 


I'(%0) = 0 (1) 


then if k is an odd number the function f attains a maximum or a minimum 
at the point xo depending on whether f&* (x9) < O or f&* D(xg) > 0. 
Proof. Here we use the expansion by Taylor's formula 


S) = f (xo) G— xo) f" (rot Se - f Doo 4- Ü(x — xo)) 


which is valid under the conditions stated. Under the additional condition 
(1) this expansion turns into 


F(x) = = Go) Se zr [f 9 (xo 8Gr— xo) 


The course of the proof is obvious. 

In conclusion we note that when a function y — f(x) has an infinite deriv- 
ative equal to + œ or to — œ ata point xo (see Fig. 5.1c and d on page 128 
and the corresponding remarks) we also say that the graph of the function 
has a point of inflection at xo. 


8 5.13. Convexity of a Curve on an Interval 


By definition, a curve y — f(x) is said to be convex upward ( downward) on 
an interval (a, b] if any arc of this curve with end points having abscissas x1 
and xz (a = xı < x2 = b) lies not lower (not higher) than the chord sub- 
tending it (see Figs. 5.9 and 5.10). 


Theorem 1. Let a function f be continuous on [a, b] and have the second 
derivative f” for x € (a, b). 

Then for the curve y — f(x) to be convex upward ( downward) on [a, b] it is 
necessary and sufficient that the inequality f" (x) = 0 (f"(x) = 0) hold for all 
x € (a, b). 

Proof. Suppose that the curve is convex upward on [a, b]. Then, for any x 
andh > Osuch that x, x4-2h € [a,b], we have f (x--h) = (fx) - /Cc--28))/2 
whence f'(x4-h)— f(x) = f(x - 25)— f (x+h). 
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y 
Oo o xi X2 b x 
Fig. 5.9 
y 
l 
Oo a x, x, b x 
Fig. 5.10 


Now, if x; and x» are two arbitrary points of the interval (a, b) we can 
write 


fon B) — fea) 9 fo 2h) - fir h) = ... = f(x) - f(x — h) 


where k = (x4— x1)/n. 
Hence, (/(xi-5h)—f (x1))/h = (f(xe—h)—f(x2))/(—h), and passing to 
the limit for A -- 0 we obtain the inequality 


f) > f'(x2) 


showing that the derivative f" does not increase on the interval (a, b). This 
means that /’’(x) = 0 on (a, b). 

Conversely, let f"(x) « 0 and a < x1 < x» < b. We have to show that 
the function F(x) = f(x)—f(x1)—m(x—x1) where m = (f (x2—f (x))/ 
l(xa— x1) satisfies the inequality F(x) = 0 on [x1, x2]. 

Suppose the contrary. Then min F(x) = F(xo) < O and x1 < xo < xz. 


Xi XX. 
Therefore F'(xo) = 0. 
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Applying Taylor's formula we receive 


0 = F (x2) = FG) TEË F" (x04 0( 3) = 
= F(xo) - E8729 fra 0(x;— Xo)) 


By the hypothesis, the first term in the rightmost member of this chain of 
equalities is negative while the second term is nonpositive; consequently the 
rightmost member is less than zero, 
and we have thus arrived at a contra- 
diction. 

In the case /"(x) = 0 the course 
of the proof is quite analogous. 


Example. The function y — sin x 
has the continuous first derivative 
(sin x)' 2 cos x and the second deriv- 
ative (sinx)" —— sin x «0 on 
[0, 7/2]. Therefore the chord OA 
(see Fig. 5.11) subtending the arc of 
the curve y = sin x on [0, 2/2] is Fig. 5.11 
below the sinusoid. The equation of 
the chord being y = (2/sz)x, we get the inequality 





2 . x 
—x<sin x, 0-mx-—— 
x 2 


which is often used in mathematical analysis. 


§ 5.14. Evaluation of Indeterminate Forms 


The laws of the mean for derivatives and Taylor’s formula we have estab- 
lished provide some powerful techniques of differential calculus which make 
it possible to compute automatically many limits, namely those which lead, 


when ordinary rules are applied, to the indeterminate forms of the type 1. =, 
co — co, 0- c», 09, os? and 1^. 


The Case 0/0. Let it be necessary to find the limit lim pe on condition 
xa 


that lim f(x) = 0, lim g(x) = 0 and ¢(x) # 0 in a neighbourhood of a. 


Let a be a finite number and let the principal terms of the expansions of f 
and ọ in powers of x—a be known: 


f(x) = a(x- a) +0((x—a)?) (x + a), ap #0 
and 
g(x) = B«(x— a) o((x— ay!) (x + a), By #0 
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Then (see § 4.10, formula (10)) we have 


uz for p = q 
fe = lim ZED . B, 





lim ay Ax X) x--a B,(x— ay n 0 for p = q 
eo for p <q 
Examples 
OEE ey x- (re strom) —F+0(1) 
1. 1 Sane l 3 = lim ELEME --—2. 
x—0* s x-0 x- (x-F +012) x—0 eto) 
ar (Iz tee) Fee 7 
2. ———- = lim ——— = lim ——— = lim — = 0. 
xoo Sinx x0 x+o(x) x0 Xto(x) xo * 
Sus polio i Lex +o) 1-x 
. lim —————— = lim c = 
+o Vi-x—cos x =o (1.5 X _(j-442 2 
j =à- g^") ( 2*4 toe ) 


$ +o) 
= lim sr ka 3. 
-0 _ s 
T (s+ $*2 +5) x*--o(x3) 

It may also turn out that the functions fand @ have no derivatives at the 
point a or that for some reason it is difficult or inexpedient to computethe 
derivatives at that point. In such cases the following general theorem whose 
proof is based on the application of Cauchy’s-mean-value theorem may be of 
"use: 


Theorem 1. Let functions f and o be continuous and have the derivatives in a 
neighbourhood of a point a (where a is a finite number or c») except possibly at 
the point a itself; also let p and ¢' be different from zero in this neighbourhood 
and 


lim f(x) = lim 9(x) = 
x—0 x—a 
Then if the limit 


m £ oD l 


(finite or infinite) exists the limit of the ratio f{(x)/p(x) as x — a also exists 
and is equal to the former: 


lim ZEL = lim L@ = 4 (2) 


xa yo) xa g'(x) = 
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In particular, this assertion also applies to right-hand and left-hand limits; 
in these cases a neighbourhood of a should be understood as a one-sided 
(respectively, right-hand or left-hand) neighbourhood. 

Proof. Let a be a (finite) number. Putting f(a) = 0 = lim f(a) and g (a) = 

X-—a 


= 0 = lim g(x) we obtain the (new) functions fand v defined and con- 


x—a 
tinuous throughout the neighbourhood in question including the point a 
itself. This property together with the properties enumerated in the state- 
ment of the theorem allow us to apply Cauchy’s theorem to the functions f 
and g. Thus, for any point x belonging to the neighbourhood there is a point 
E = a46(x—a) (0 < 0 < Y) lying between a and x such that 


Six) — f(x)-f(a@) = S'E) (3) 
p(x)  9(0-9(aQ (5 


If limit (1) exists then obviously the limit 


ua FE) 7 
am Pe) 4 
also exists and hence so does limit (2). 
We see that the existence of the second limit in (2) implies the existence of 
the first limit in (2) equal to the former. But the converse is not true. 


Example 4. Since sin x ~ x (x — 0) we have 


li x sin (1/x) 


. - 1 
: = lim x sin—=0 
sin x x 


x—0 
On the other hand, the corresponding ratio of the derivatives is 


2x sin (1/x)— cos (1/x) -2x 1 sin do cos (1/x) (4) 
cos x cos x x cos x 

It obviously has no limit as x — 0. This follows from the fact that the first 

term.on the right-hand side.tends to zero while the second term has no limit. 

But this does not contradict the fact that when the function £ = &(x)-ap- 

pearing in Cauchy's theorem is substituted for x into (4) the resultant expres- 

sion has a limit for x — 0. 

Now we proceed to the case a = œ (or a —-F es» or a —— œ). Let us 
make the substitution x = 1/u. This results in the functions F(u) = f(1 Ju} 
and (u) = p(1/u) of the argument u. They are continuous in a neighbour- 
hood of the point u = 0 (in the cases a=+o and a — — œ they are 
respectively continuous in a right-hand and a left-hand neighbourhood of the 
point u — 0), have the derivatives with respect to u in that neighbourhood 
and both @ and @’ are different from zero in it. 

We also have lim F(u) = lim f(x) = 0 and lim ® (4) = lim (x) = 0. If 

ua x—> on u X— co 


the limit lim £& exists then obviously the limit of the ratio F’(u)/®‘(u) 


Xw 9'(x) 
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as u - 0 also exists and is equal to the former: 


F'(u) = lim füj-iw. li f(x) 
nao Olt) — 4.9 v(QI/u) C7 du) x P(x) 





Hence, by what was proved above (for a finite a), we conclude that 


li f(x) Eu Fu) Q2 FU) _ im f'(x) 
X—-o0 p(x) u—0 Bu) ~ H9 PW) ~ x—> co 9'(x) 





The theorem has been proved. 
The Case ~/oo. There holds the following theorem. 


Theorem 2. Let functions f(x) and p(x) be continuous and possess the deriv- 
atives f' and q' in a neighbourhood (in particular, in a right-hand or a left- 
hand neighbourhood) of a point a (finite or infinite) except at the point a 
itself. Also let p and q' be different from zero in that neighbourhood and 


lim f(x) = lim g(x) =< (+æ or — e) (5 


Then if the limit lim LC) ~ A exists the limit of the ratio f(x)|g(x) as 


p(x) 
x--a 
x — a also exists and is equal to the former: 


foe) qu LOL 
x—a Px) X--ü p(x) 





(6) 
The proof of the theorem is based on the following lemma. 


Lemma. Let lim fx) = lim g(x) = æ. Then there is a neighbourhood of 


x“ 
ain which there exists a function x’ = A(x) such that lim x = lim Aw) =a 
xa 
and, simultaneously, 


fe»). ex) _ 
lim “Fay Ta) = O and lim oe) PO =0 (7) 
that is 7 
F(x) = fG)-fG) and 9(x)zee(Qx)—-9(x) — (x-2) 

Proof. In the course of the proof we shall suppose, for the sake of defi- 
niteness, that a is a finite number and that x tends to a so that x <a all 
the time. The other possible cases are treated similarly. 

Let us choose xı < a such that | f(x)| > 0 and [g(x)] > 0 for x = xı and 
also take x2 (x1 < x2 < a) such that 

fo) P(x) 
f(x) b P(x) $5] E 


Next we choose xs {x2 < xa = a) so that 


fe gx) 
Stas) "e Ims E 





(Xa = x <a) and a— xz <5 





(Xs < x < a) and a— xs <5 
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Proceeding in this way we obtain an increasing sequence {x,,} convergent 
to a such that 














fo | p(x) 
Fey)" (wai Gua <a), 
1 
a Xr+ = rwn (n = 1, 2, iu .) 


Now we setan arbitrary value x € (x2, a), choose a (uniquely determined) 
natural number n = n(x) corresponding to it such that Xp}1 — x « Xn+2 
and then put 

x’ = (X) = Xn 
Obviously, x' — a, n — œ for x ~ a, | f(xy/f(x)| > n and leCo/g(x)] > 


> n. It now follows that (7) takes place. 
The Jemma has been proved. 


The Proof of the Theorem. We have to compute the limit lim f eL, As 





is already known, 
fo) ~ f(x) —-f0’) and = (x) ~ o(x)—9(x') as x > a 
Hence (see § 4.10, (8)) we have 


lim L&L = jim 097/62 


x-a plx) x-a ex) G(x’) 





By Cauchy's mean-value theorem, 


So- _ FS) 


pa-p) P’ u ey. Ors Oye) 


Now we see that if the limit lim xt @) (finite or infinite) exists the limit 
f^ ae f'@) f(x) 
lim 1 FO also exists and is equal to the les limit: lim 55 by = lim bv 


Consequently, 





in LCL = tim LM 


xa P) xg P(X) 


which completes the proof of the theorem. 

Again, the existence of the second limit in equality (6) implies the existence 
of the first limit equal to the former but, as the following example shows, the 
converse is not true: the limit 


. x—sin x . fsin x 
i oa oe aie 
exists while the limit of the ratio (1 —cos x)/1 of the derivatives does not 
exist as x + co, 

The rule stated in Theorems 1 and 2 according to which the computation 
of the limit of the ratio of functions can be reduced, under certain conditions, 
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to the computation of the limit of the ratio of their derivatives is called 
L'Hospital's rule after G.F.A. L’Hospital* who stated this rule for some 
simpler cases; this rule was in fact known to Johann Bernoulli** before 
L'Hospital. 

Other Types of Indeterminate Forms. It now remains to consider the 
other types of indeterminate forms which turn out to be reducible to the two 
types treated above. 

If f +o and 9 — œ we write f—9 = (2-3 and thus obtain an in- 
determinate form of the type 0/0. 

If f + Oand p — œ we write fp = ps , which leads to a form 0/0. 


The expressions of the form 4? which lead to the indeterminate forms 0°, 
c»? and 1* are found by taking logarithms; this results in indeterminate 
forms of the type 0- e. 


x lim vinu, ape F 
For example, we have lim w? = ene if the limit of the exponent in the 


xa 
right member is finite. If the latter limit is equal to + œ or — œ the limit of 
the left member is respectively equal to + œ or 0. 


Examples 
i 
5. lim ih d - 0. 
xo = X--90 
ES 
6. lim x In x = lim n lim == 0. 
x0 x—-0 07 x70 _ 7. 
x0 x-0 x x-0 xy? 
: : x . -1 3 k! 
7. lim x*e*- lim = = lim ke = ...= lim —-20 
> +o x eo x +00 x +o e 
(k-—:1; 2:4). 


8 5.15. Piecewise Continuous and Piecewise Smooth 
Functions 


We say that a function f'is smooth on a closed interval [a, b] if it possesses 
a continuous derivative in this interval. 

As usual, it is meant in this definition that at the points a and b the func- 
tion f has, respectively, the right-hand and the left-hand derivatives. A smooth 
function on [a, b] is automatically continuous on (a, 5] since its derivative 
exists throughout [a, b]. 


* G.F. A. L'Hospital (1661-1704), a French mathematician. 
+% Johann Bernoulli (1667-1748), a Swiss mathematician. 
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An equivalent form of this definition reads: a function f is smooth on 
[a, b] if it is continuous on [a, b] and has the continuous derivative f'(x) in the 
open interval (a, b) such that the limits 


f'(a--0)— A and /f'(b-0)— B (1) 


exist. 
It is clear that the first definition implies the second. Now suppose that 
fis smooth in the sense of the second definition. Then 


flor Wf) — P(a-4- Oh) — — A(h-0,h—0,0-8-1) (2) 


and consequently f has the right-hand derivative at the point a equal to 
f'(a) = A. By virtue of the first equality (1), the derivative f' is continuous 
from the right at that point. The existence and the continuity of the deriv- 
ative of f at the point b and the equality f* (b) = B are proved similarly. 
Hence, the function f turns out to be smooth in the sense of the first defini- 
tion as well. 

A function fis said to be piecewise continuous on a closed interval [a, b] if 
it is defined and continuous throughout [a, b] except possibly at a finite 
number of points xj (a = x1 = ... < xy = b) at which the right-hand and 
the left-hand limits of f exist, that is the finite numbers f(x,— 0) and f(x;--0) 
exist. Here of course for x = a and x = b only f(a+0) and /(b—0) are 
respectively meant to have sense. 

Thus, a piecewise continuous function f on [a, b} is continuous on each 
of the intervals (xj, xj4.1). Furthermore, irrespective of whether or not it is 
defined at the points x, and x;41 the function can be redefined or defined at 
these points so that the result- 
ant function is continuous on 
the chosen closed interval 


[xj, Xj41]- 


Example 1. The function [x] 
defined as the greatest integer 
not exceeding x is an example 
of a piecewise continuous 
function on any closed inter- 
val [a, b]. Its graph is shown in 
Fig. 5.12. The points of discon- 
tinuity of the function [x] are 
the integral values x = 0, 1, 
+2, ... The discontinuities 
at these points are of the first 
kind, that is the right-hand 
and the left-hand limits of the 
function exist at these points. 
Let us consider one of the inter- Fig. 5.12 





20006—12 
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vals of continuity of the function with maximum length 1, for definiteness, 
the interval (1, 2). The function [x] is continuous on this interval. On the 
corresponding closed interval [1, 2] this function f(x) = [x] is no longer 
continuous since /(2—0) = [2 —0] z [2] = /(2). But if we redefine the func- 
tion by putting it equal to 1 for x = 2 the resultant function is continuous 
on [1, 2]. 

We shall say that a function fis piecewise smooth on a closed interval [a, b] 
if it is itself piecewise continuous and if its derivative f" exists and is also 
piecewise continuous on [a, b]. This means that the interval [a, b) can be 
partitioned with the aid of points of division 


a= Xo Xi... XN — b (3) 


so that f is continuous together with its derivative f’ on each of the intervals 
(xj, Xj 4.1) and, besides, the one-sided limits of both fand f" exist at the end 
points of these intervals. 

Choosing a definite subinterval [x;, xj.-1] we can define (if fis not defined 
at some of the points of division) or redefine f at the end points x = x; 
and x = x;41 So that it assumes, respectively, the values /(x;4-0) and 
f(x) 1— 0) at these points; then, as was shown at the beginning of this section, 
the (new) function fis smooth on the interval [xj, x;4.1]. 

For instance, the function y(x) — [x] is obviously not only piecewise 
continuous but also piecewise smooth on any closed interval [a, b] because on 
the intervals (m, m+ 1) where m is an integer it is continuous together with 
its derivative and at the end points of these intervals there exist the corre- 
sponding one-sided limits of y and y'. If we replace the value y(m4- 1) = 
= m--1 by the new value y(m-+1) = m, the (new) function y turns out to 
be constant and, consequently, smooth on the. closed interval (im, +1] 
(see Fig. 5.12). 

An important special case of a piecewise smooth function is a continuous 
piecewise smooth function f on a closed interval [a, b]. Characteristic features 
of such a function are: 

(i) fis continuous on (a, 5]; (ii) there is a (finite) partition (3) of the in- 
terval [a, b] such that f is a smooth function on each of the subintervals 
[x Xie 1). 


Example 2. The function |x| is not smooth on [—1, 1] because it has no 
derivative at the point x = 0. On the other hand, |x] is a continuous and 
piecewise smooth function on [—1, +1] since it is continuous throughout 
[— 1, +1] and has the continuous derivatives — 1 and +1 in, respectively, 
the open intervals (— 1, 0) and (0, 1), and the derivatives themselves have 
the corresponding one-sided limits at the end points of these intervals. 


It is obvious that 
i +1 forx>0 
|x|’ = sgn x = 
—i forx <0 


The function sgn x is considered as not being defined at the point x = 0. 
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Exercises 


1. Show that the function whose graph is depicted in Fig. 5.6 is piecewise 
smooth. Also show that the functions with the graphs presented in Fig. 5.1, 
c-f, are not piecewise smooth. 


Hint. Take into account that these functions have infinite (at least right- 
hand and left-hand) derivatives at the point xo. 
2. Show that the function 


0 forx =0 
x)= 1 


x? sin — for 0 «|x| «1 


is not smooth on the interval [— 1, +1] in spite of the fact that its derivative 
exists at all the points of the interval. 

3. Prove that if a function f is continuous but not smooth on a closed 
interval [a, b] and if at the same time it is smooth on each of the subintervals 
[a, c] and [c, b] then f has no derivative at the point c although its right- 
hand and left-hand derivatives at this point exist. 

4. Show that if fis continuous and possesses the derivative f’ at all the 
points of [a, b] the derivative cannot have discontinuities of the first kind 
(in Exercise 2 the derivative of f, although it exists everywhere on [— 1, +1], 
has a discontinuity of the second kind at x = 0). 
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CHAPTER 6 


n-dimensional Space. 
Geometrical Properties of Curves 


§ 6.1. n-dimensional Space. Linear Space 


An arbitrary ordered system x = (x1, ..., X,) of n real (complex) numbers 
xj (a number n-tuple) is called a vector or a point or an element of the real 
(complex) n-dimensional space R,. Hence, R, (also called the n-space or the 
n-dimensional Cartesian space) is the set of all such x's. 

For the vectors (points) x, y € R, we shalldefine theoperations of addition 
and subtraction and also the operation of multiplication of the vectors by 
real (complex) numbers according to the following rule: if x = (x1, ..., Xn) 
and y = (Yı, ..., Yn) are arbitrary vectors and «, B are some real (complex*) 
numbers then 


ax tBy = (ax. tyi, mony OX, ys) 


The vector (point) 0 = (0, ..., 0) is called the zero vector (the origin) of 
R,. Obviously, x+0 = x for any x € R, We also put (C I) x = — x; then, 
apparently, x — y = x+(—y). 

In mechanics and geometry an element x = (x1, ..., Xa) of the space R, 
is spoken of as a vector with point of application at the origin and terminus 
at the point x = (x1, ..., x,). In the cases of dimensions 2 and 3 this termi- 
nology has a visual geometrical sense. 

The properties enumerated below are checked directly on the basis of the 
above rule: 


(i) x+y = y+x; 

(ii) (x-- y) z = x+(y+2); 

(iii) x+y = x+z implies y = z; 

(iv) axtay = a(x+y); 

(v) «x Bx = («t B)x; 

(vi) «(8x) = (aB)x; 

(vii) 1-x = x 
(here x, y, z € R, are arbitrary vectors and x, # are any real or complex 
numbers). 


* On complex numbers see $ 8.2. 
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An abstract set E consisting of elements x, y, z ... of any nature is called 
a real ( complex) linear space if there is a law according to which, for any 
two elements x, y € E there is defined an element x+y € E called the sum 
of x and y and if, for any real or complex number « and any element x € E, 
there is defined an element «x € E (called the product of x by «) so that the 
enumerated properties (axioms) (i)-(vii) hold. 

What has been said shows that R, can be regarded as an example of a 
linear space, but there are also many other examples of this kind. For in- 
stance, the set of all (infinite) sequences x = (xi, x», ...} of real or complex 
numbers becomes a linear space if we put 


ax+ßy = {axitByi,axo+Pye...} and y-íyuys...) 


The subset of this set consisting of all sequences convergent to finite limits 
is also a linear space if the operations of addition of sequences and their 
multiplication by numbers are defined in the same manner as above. Further, 
the set C of all (real or complex) functions f defined and continuous on a 
closed interval [a, b] is another example of a linear space if, as usual, the 
operations of addition of functions and their multiplication by numbers are 
performed according to the ordinary rule 


&f-Bp —«f(x)t*BeG) | (o €C) 


Finally, the set of all polynomials P,(x) = Y ax of degree not higher 


0 
than n is also a linear space if the addition of polynomials and their multipli- 
cation by numbers are understood in the ordinary algebraic sense. 


The subtraction of elements of a linear space and the zero element are not mention- 
ed explicitly in axioms (i)-(vii) but these notions do in fact arise on the basis of these 
axioms. If we put 0, = 0-x then x 4-0, = x -0-x = 1-x = x. Introducing similarly the 
element 0, = 0-y we obtain the relation y+8, = y. For 0, and @, we then have 


x+y+0, = x+(y+9,) = x+y, 
X-yTÓ,— x+(0,4+y) = (x40) y = xy 
whence, by Axiom (iii) it follows that 6, = 0, = 0 for any x, y € E. Consequently, 0 is 
the zero element of E since the relation x4 — x is fulfilled for any x € E. 
Next we put -x = (—1)x; then x+(— x) = (1—1) x = Ox = 0, and the subtrac- 
tion of any two elements x, y € E, that is their difference x—y, is defined with the aid 


of the equality x — » = x 4-(— y). The latter operation is inverse to the operation of ad- 
dition: 


(x-9)y = x(-Hy-2xrl-»-04y] = x+0 =x 
8 6.2. n-dimensional Euclidean Space. 
Spaces with Scalar Product 


Let R, be a real or complex n-dimensional linear space of n-tuples. 
Taking its two arbitrary points (vectors) 


x = (Xn -- -5 Xa) and Y=On -- -s Yn) 
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we associate with them the number 


n 
e») = Y xy (1) 
J=L 
which is called the scalar product of the vectors x and y. 
Here the bar over y; designates the operation of passing to the complex 
conjugate of y,. In the case of real space the numbers y, are real and y; = yj. 
The scalar product obviously possesses the following properties: 
(i) (x, y) = (7, x) 
(ii) (x, y) is a linear form in x, that is, given any vectors x, y, zand numbers 
x and fj, there holds 


(cx By, z) zu a(x, z)+B(y, 2) 
By Property (i), it follows that 
(x, ay tz) = a(x, y)-- Br, z) 


(iii) (x, x) 2 0 for any vector x; equality (x, x) = 0 implies x = 0 
because it means that x, = 0, j = 1, ...,m. 

Now we state the following definition: a (real or complex) linear space 
E to whose any two elements (also called generalized vectors) x and y there 
corresponds, in accordance with a definite law, a number (x, y) so that 
conditions (i)-(iii) hold is called a /inear space with scalar product. 

If E is a real linear space then, evidently, the bars designating the complex 
conjugates in conditions (i)-(iii) can be omitted. 

Now we can say that the n-dimensional space R, for which relation (1) is 
introduced is a space with scalar product. 

Mathematics also deals with many other linear spaces with scalar product. 
Some of them will be studied in our course (see Chapter 14). 

Let x and y be two elements of a linear space E with scalar product and 
let A be an arbitrary number which, depending on whether E is a real or 
complex space, can be real or complex. 

By properties (i)-(iii), we then have 


0 <(x+Ay, x+Ay) = (x, x) E AG, y) - AQ y) - 140, y) Q) 
If (y, y) = 0 we can form the number 


2 0€,» 
Ae W, ») 9 


and substitute it into (2). Since we have ad = |a|? for any complex number a 
the substitution results in 


2 
A(x, y) = 353)  — 9E = - po, y) 





That is 


2 
0 (x x) ERE (4) 
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Relation (4) leads to Bunyakovsky's" inequality 
I(x, y) = (x, x)? (y, yy^ (5) 


It continues to hold for the case (y, y) = 0, that is when y = ô is the zero 
element, since (x, 0) = (x, 0.0) = 0(x, 0) = 0. 
Taking two arbitrary elements x, y € E we can write 


(x+y, x+y) = (x, x) +(x, y) HQ, x) Qn y) = (x, 3) 22165 y) +, y) = 
= (x, x)H-2V/ (x, x) Y y) 0.3) = VOA © 


and thus arrive at another important inequality: 
(x y, xc y)? = (x, x)? (y, yy? (7) 


For any pair of elements of the form x = ay, y where œ is a number and 
y is arbitrary or y = Oand xis arbitrary, inequality (5) turns into the exact 
equality 


I y)| = (x, x)? (y, y)? (8) 


Conversely, if equality (8) is fulfilled then either y = 0 or relation (2) 
holds with the equality sign and with 2 defined by formula (3); in the latter 
case Property (iii) of the scalar product implies x+Ay = @. 

It is evident that inequality (7) becomes an exact equality if either y = 0 
or x = ay where « is a nonnegative number. 

Conversely, if (7) turns into equality all the relations in (6) turn into 
equalities whence it follows, in particular, that (8) holds. Consequently, 
either y = 0 or x = «y where « is a certain number. Next, putting x = ay 
in equality (7) and taking y such that (y, y) > O we obtain, after cancelling 
by (y, y), the equality | 1--«| = 1--1«| whence œ = 0. 

The arithmetic square root of (x, x) is termed the norm of x and is denoted 
Hxi[z1lx]| = (x, x)!? (see the next section). 

The n-dimensional space R, in which scalar product (1) and, together 


n 1/2 E 
with it, the norm ||x|| = [Y |+;[?). -are introduced for the element 


1 
x=(xX1, ..., Xa) is called the n-dimensional Euclidean space**. The norm ||x || 
of an element x of the n-dimensional Euclidean space will also be denoted 
as |x|. For n 2 3the norm |x| = (x3-+23+.2)" of a vector x = (xi, x2, xa) 
coincides with its length (the same is of course true for n = 2 and n = 1). 


* V. Ya. Bunyakovsky (1804-1889), a distinguished Russian mathematician who 
deduced this inequality in 1859. For number sequences this important inequality was 
established in 1821 by A. Cauchy who used a terminology different from that of the theory 
of linear spaces (see below). For some other cases (5) was derived in 1884 by H. Schwarz 
(1843-1921), a German mathematician. That is why (5) is sometimes referred to as the 
Cauchy-Bunyakovsky-Schwarz inequality.—Tr. 

** An arbitrary linear space E with scalar product is also called a Euclidean space 
(in the general case it can be infinite-dimensional).—77. 
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For the elements of the n-dimensional Euclidean space inequalities (5) 
and (7) turn, respectively, d the corresponding inequalities 


ly (Sts) (Zoe) j (9) 


yx 
1 








and 
n 1/2 n 3 1/2 n 1/2 
(Èi +) < (È Ix) + (pF) (10) 
1 1 1 
It follows from (9) that for number x-tuples (x1, ..., Xa) and (yu ..., Yn) 


È = (ioe) (Zn (11) 


because we can apply inequality (9) to the nonnegative numbers |x;| and 


Iyb-l»k : LL 
We also mention the inequalities 


n n 1/2 n 
arcs (Y sr «Yl (12) 
1 j-1 1 


The first of them follows from (11) if we put y; = 1 (j= 1, ..., n) and the 
second can be checked directly by squaring its both members. 

Relation (9) is called Cauchy’s inequality and (10) is a special case of a 
relation known as Minkowski’s inequality (sec § 14.2, formula (12)). 


§ 6.3. Normed Linear Space 


A linear space E of elements x, y, ... with each element x of which is 
associated a number || x || satisfying conditions (i)-(iii) stated below is called 
a normed linear space and the number || x]| is called the norm of the element 
x. The conditions mentioned include the following properties: 

(i) ||xl| = O for any x € E; equality ||x|| = O implies x = 6, that is in 
this case x coincides with the zero element Ó of the linear space E. 

(ii) ||ax]| = |x| |x| for any x € E and any number « (which can be real 
or complex depending on whether E is a real or complex space). 

(iii) |x-FyM = |lxll+llyll for any x, y € E. 


Now we see that the Euclidean space R, is a normed space with the norm 
n 1/2 
sil = ll = (Es) () 
1 


It is also possible to introduce some other (non-Euclidean) norms in the 
space R,. For instance, we can define the norm by putting 


Ix ]| = max (Ixsl, xol, . <- Dxsl) (2) 
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for the points (vectors) x = (x1, ..., Xn) € R, or we can take 
n Up 
lxi = ($ls) dup (3) 
1 : 


The reader can easily check that relation (2) defines a norm and that for 
p = 1 relation (3) also defines a norm (the general case of an arbitrary p is 
treated in § 14.2). 

Relation (iii) is termed the zriangle inequality. In the cases of two-dimen- 
sional and three-dimensional Euclidean spaces it does in fact express the well- 
known geometrical property: the length of a side of a triangle does not 
exceed the sum of the lengths of its other two sides; thus, in particular, (iti) 
can be regarded as an analytical proof of this geometrical theorem. 

Replacing x by x —y or y by y—x in (iii) we obtain 


lx» = jlx- Iix—»li 2liyi-ilxi 
and hence 


Ix» = Hx- yil] (4) 


For a normed space £ we can define the notion of limit. A sequence of 
elements x, € E is said to be convergent (to tend) to an element x € E 
if ||x, —2x|| — O (n — œ). In this case we shall write x, > x or lim x, = x 
(n +2), 

If a sequence of elements x, € E has a limit x € E the latter is determined 
uniquely because x, — x and x, -- y imply 


Ix —»1| = HQ x2) Qo 7 9) < Hx — xul xs»! + 0 


whence || x —y|| = 0, that is x = y. 
Since [Iix,Il — 1] x ll] a ll x,— xl — 0, the convergence of x,, to x implies 
that || x,|| tends to |[x|]: 


lx, > xpo Gro) 


If Xn y,, x, y are elements of E and =,, x are numbers and if x, > x, 
Yn > y anda, ~> « then 


lim (x,+y,) = x+y and lim (x,x,) = ax 


Indeed, we have 
lx xy)- Gu xy» «llx-x,ll-il»-»l-0 (1 +) 
and 
[| &x —, x, P HC ,) x aro -- x,) | = |I (x — ænx J| + 
tes (x— x «1«—2xlxi-4Ielx—xli-0  (m--) 
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8 6.4. Vector Function in n-dimensional 
Euclidean Space 


Let E be a set of real numbers ¢. If there is a definite law according to 
which to every £ € E there corresponds a vector* 


r= x(t) = (xi), x(t), sss x(1)) (1) 


we shall say that the correspondence (1) defines a vector function x(t) on E. 
An ordinary function «(t) (which assigns to each t € E a number a(é)) is 
also called a scalar function. 
We shall say that a vector function x(f) has a limit at a point Zo equal to 
a vector y = (ys, ..., Ya) and shall write 
limx=y or x(-—y (t — to) (2) 
tf 
if 
lim |y —x(D| = 0 (3) 
fle 


or, which is the same (see the explanations below), if 
limx(j=y, (-—1...n) (4) 


{tg 

Equality (3) says that the scalar function |y—x(£)] of the argument £ 
tends to zero limit as / — £o, and, as we know, this means that the function 
is defined in a neighbourhood of the point ¢) except possibly at the point 
to itself; therefore all its components xj(f) are also defined in this neigh- 
bourhood. 

As follows from formula (11) in§ 6.2, there hold the inequalities 


= ;— x,(2)| <= ds |y; — x(01 = [2 6-1" = |y—x(0)| 


„which imply that if (3) holds then (4) holds as well for all j = 1, ..., n 
and vice versa. 
By definition, we say.that a vector function x(/) has a right-hand (left- 
hand) limit at a point f equal to y = (yi, ..., Yn) if 


jx()—y| ^ 0, t+ to, t > to 
(Ix()) —»1 — 0, £ — to, £ < to respectively). These limits are denoted as 
x(to+0) = lim x(f) and x(to—0) = lim x(4) 
tto 


lg 
tf tto 


Arguing as above we readily see that 
x(to+0) = (x1(to+0), .. ., x,(1o--0)) 


* Here we mean vectors x belonging to the real space R, but all the considerations 
remain valid for the complex space A, as well. 
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and 
x(to—0) = (x1(£0— 0), ..., Xn(Zo—0)) 


and that the existence of the vector limits on the left-hand sides of these 
equalities implies the existence of the corresponding limits of the compo- 
nents of the vectors and vice versa. 

We say that a vector function x(t) is continuous or continuous from 
the right or continuous from the left at the point to if, respectively, the 
limit lim x(t), or x(to+0) or x(£9—O0) exists and is equal to x(£o). 

ito 

These definitions are obviously equivalent to the requirements that the 
components x,(t)(j = 1, ..., n) should be, respectively, continuous or con- 
tinuous from the right or continuous from the left at the point fo. 

It appears evident that x(¢) is continuous at ¢ = fo if and only if the limits 
x(to), x(to-- 0) and x(to— 0) exist and the equalities x(/o) = x(to+0) = x(to— 
— 0) hold 

The derivative of a vector function x(t) at a point t is defined as the limit 


ory Ax Qu Sh- _ quo Ax 
MU upto eco up 

provided that it exists. The mth derivative of x(/) is defined by induction: 
d"x d dmx 


Lum de uer (m —2,3, ...) 


Its existence obviously implies the existence of the derivatives of the mth 
order of the components of x and vice versa. We also have the equality 


d" m m 
T = CAPO, ux) (M@= 1,2...) 
The derivatives of the first and of the second order (and sometimes higher- 
order derivatives as well) are also designated by dots:. 
x = x(t), X = X(t) 


If x(¢) and y(£) are vector functions and «(‘) is a scalar function we have 
the relations 


lim [x(2) y(0)] = lim x(?) x lim ») 
lim [a(#) x(t)] = lim «(¢) lim x(2) 


and 


dx day 
‘dt dt 


42 


top aq (en) =a 


(ety )- 
where it is of course us that the limits and the derivatives entering 
into the right-hand sides exist. The proof of these equalities is quite simple 
and is based on the passage to the corresponding components (coordinates) 
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of the vectors. For instance, 
lim [x(n yN] = (im Da() En] .... lim [x.(£) t») = 


= (lim xi() tlim yi(£), ..., lim x,()+lim PD) = 
to ff flo tf 


= (lim x(t), ..., lim XD) + (lim yx) ..., lim Yall) = 
7o lo lo 


I-—fo 
= lim x(t)+lim y() 
tfo tp 


It is also possible, of course, to retain the vector notation in this proof. 
For example, putting lim x(t) = f and lim x(t) = y we obtain 
t+fo tty 
1o (0) x0) — By| = L0) — 8] AHE- Y) <12(2)—Bl lx@1+ 
*I8lix()—»|— 0-y1-181-0 — 0, tbo 


8 6.5. Curve in n-dimensional Space 


If ¢ increases continuously and runs through [a, 5] (or (a, b)) the point 
specified by the continuous vector function 


x(t) = (vit), t 9y(t)) € R, (1) 


describes a set of points belonging to R, which is ordered by means of the 
variable t; this set is called the hodograph ( trajectory) of the vector function 
x(t). It is not excluded that the moving point x(/) may return to a point of 
the space R, through which it has already passed for some other value of the 
parameter £. In the cases of dimensions n = 2 and n = 3 such trajectories 
have a real geometrical meaning. 

Proceeding from a given vector function (1) we can construct a new vector 
function defined by the vector equalities ' 


Xa(t) = x(4(2)) = (9149), us Pn(A(z))) 


(refe d) or zele, d) Q) 
or by the equivalent system of scalar equalities 
xi — Pelt) = p1(A(z)), sey XQ = 9u(1) = Pn( A(t) (2) 


where ¢ = A(t) is an arbitrary strictly monotone (real!) function specifying 
a (one-to-one!) mapping of the closed interval [c, d] (open interval (c, d)) of 
variation of the new variable t onto the closed interval [a, b] (open interval 
(a, b)) of variation of the old variable z. 

It is clear that equation (2) specifies the same trajectory I’ as equation (1) 
and that the orderings of its points induced by the variables £ and c are the 
same if A(z) is strictly increasing or have opposite senses if A(z) is strictly 
decreasing. 
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Equation (1) is said to determine a continuous curve 1" with the aid of the 
parameter 7 while equation (2) is said to determine the saine curve I" but with 
the aid of the parameter t. Thus, to different strictly monotone continuous 
functions A(z) there correspond different parametric representations of one 
and the same continuous curve I. 

The function A(z) can always be chosen so that c = 0 and d = 1. 

The functions 2(z) can be divided into two classes: the class of strictly 
increasing functions and the class of strictly decreasing functions. The first 
class specifies the ordering of the points of I’ in one sense and the second 
class the ordering in the other, opposite sense. In this connection there ap- 
pears the notion of an oriented curve I’. For instance, we can denote by T4 the 
curve I" oriented with the aid of the parameter f. 7" , also determines all the 
possible equations (2) in which 2(z) are continuous strictly increasing func- 
tions. The same curve J’ supplied with the opposite orientation is then natu- 
rally denoted by I". .. The oriented curve Z7. is specified by the class of all pos- 
sible equations (2) with continuous strictly decreasing functions A (1). 

A curve T is said to be smooth on [a, b] (on (a, b)) if it admits* of a para- 
metric representation (parametrization) with the aid of a smooth vector func- 
tion x(t), the latter being a continuous function possessing a nonzero deriv- 
ative on [a, b] (on (a, b)) or, which is the same, a vector function x(t) 
whose all components x;(f) are smooth scalar functions on [a, b] (on (a, by) 
whose derivatives do not vanish simultaneously. The last property is equiva- 
lent to the fact that 


o= Y pj 0, tela, b] (a,b) (3) 
j=l 


In this formulation, the continuity of x(t) at the end points a and b is of 
course understood as one-sided continuity: from the right at a and from the 
left at b. As to the derivative x'(r) at a and b, it is understood as the right- 
hand derivative at a and as the left-hand derivative at b. 

We shall say that is an admissible parameter for.the smooth. curve T 
represented by equation (1) if it is connected with ¢ by means of an equality 
t = A(z), t € [c, d] ((c, d)) where A(z) is a function which is not only strictly 
monotone and continuous but also possesses a continuous derivative on 
[c, d] (on (c, d)) different from zero. Thus, the derivative A'(z) must in fact 
haveconstant sign on [c, d] (on (c, d)), i.e. “+” or *— ". If v is an admissible 
parameter then the defining property of a smooth curve stated above in 
terms of the parameter t continues to hold if it is stated in terms of t because 
the vector function x(A(z)) = x,(v) has a continuous derivative on [c, d] 


* This definition does not exclude the possibility that a smooth curve can be represented 
parametrically by a function not satisfying the stated requirements. For instance, we can 
introduce a new parameter t by means of a substitution ¢ = A(z) where A(r) isa strictly mo- 
notone continuous function whose derivative vanishes or does not exist for some r. 
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(on (c, d)) which, in addition, does not vanish: 


Y xyGy = APY xy > 0 
j21 j=l 
Let us choose a point (x2, ..., x9) = x° € I' corresponding to a value 

to € (a, b) of the parameter ¢. At least one of the terms in the sum on the 
right-hand side of (3) must be positive; for definiteness, let it be the nth 
summand: x,(to)* > 0. Then there exists a neighbourhood* of the point fo 
in which x,(r) retains sign, and the equation x, = x,(!) can be resolved 
with respect to ¢ in this neighbourhood: 


t= u(x) (N < Xn < xn») 


where 71, 72 > 0 are some numbers and p is the inverse function of x,(t) 
which is continuous and has a continuous derivative. This means that the 
portion of the curve (1) in question which corresponds to the indicated 
neighbourhood and is determined by equations (1) can also be determined 
by the equations 


x; — us) = x([u(x4)] (j= 1, ..., n-1) 
Xy = Xn (x8-—m < Xy cm x-4-72) 


These equations can be differentiated once (in the indicated neighbour- 
hood): 








dx 

dx, _ “dr Lm 

de eg (j= 1, ...,n—-)) 
dt 


Summing up we state the following theorem. 


Theorem 1. For any point x? of a given smooth curve I’ corresponding to a 
value t = to € (a,b) of the parameter t there is a sufficiently small number 
. ô > 0 such that the portion of T corresponding to the variation of t in the inter- 
val (to—6, to+ 0) can be represented parametrically with the aid of at least 
one of the coordinates xy: 


x-9(x) (-L..,i-Litl..,m $M < xX < x+n) 


where the functions x; = qj(xi) possess the continuous derivatives 


dx, 

dx — d T - 

a ue (—1,...,i—1, i+], ..., n) 
dt 


*[f 4, = aor f, = b then by a neighbourhood is meant a one-sided (i.e. a right-hand 
or left-hand) neighbourhood of the point /,. 
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In particular, in the two-dimensional case a smooth curve is determined 
by two equations 


x= 9), y=) (¢€ (a, 5) (4) 
where p and y possess continuous derivatives not vanishing simultaneously. 
If, for instance, (fo) = 0, then there exists an interval (fo— ô, t9-- ô) on 
which ọ has the inverse function ¢ = g(x) and y = f(x) = (~~ (x)). In 
such a case we usually say that the function y = f(x) is specified paramet- 
rically by equalities (4), and formula 


dy 
dy _ dt 
dt 


is interpreted as providing a paramerric representation of the derivative of the 
function f(x). It is also evident that 


dy | d (2:) _d (2) di x — yin (6) 


dé dx Vx] dt \xi} dx — x? 


if we additionally assume that the second derivatives x;' and y;' exist. 

We say that T'is a piecewise smooth continuous curve on [a, b] (on (a, b)) if 
it can be represented by a continuous vector function x(7) on [a, 5] (on (a, b)) 
such that the closed interval [a, 5] (the open interval (a, b)) can be split into 
a finite number of parts by means of points of division a = tọ < ti < ... < 
« ty = bso that x(t) is a smooth curve on each of the subintervals" [a, 4], 
[t tə], sees [x-i b]. 

Jn should be taken into account that, generally, at a point of division 
tk (k = 1, ..., N—1) the left-hand derivative x(7,—0) may not be equal to 
the right-hand derivative <(t,+0) but at the same time both derivatives are 

. different from zero (that is among the components of each of them there 
is at least one different from zero). 

The various parametric representations of a piecewise smooth continuou 
curve I’ are given by equation (2) with functions ¢ = A(z) having on [c, d] . 
(on (c, d)) continuous derivatives A'(z) not turning into zero. 

A smooth curve of type (1) is called a Jordan curve after C. Jordan (1838- 
1922), a noted French mathematician. If we have x (a) = x(b) for such a curve 
it is called a closed (Jordan) curve. If a curve of this kind is such that the 
fact that x(f1) = x(t2) implies that either ^4 = ¢2 or one of the numbers z, and 
t» is equal to a while the other is equal to b, the curve T is said to be a 
closed Jordan curve not intersecting itself or a continuous closed curve without 
self-intersection or a simple closed curve. 

If equalities x(t;) = x(t) (t1, te € [a, b] or 4, t2 € (a, b)) imply t; f» we 
say that I’ is a nonclosed curve not intersecting itself. 


* [n the case of an open interval (a, b) the subintervals (a. f,] and [ty_1, b] are respec- 
tively replaced by (a, t,] and [r4 ,, b). 
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In the case n = 2 we have a plane continuous curve 
Xi = Xll), xa = xe(t, ? € [a, b} or t€ (a, b) (7) 
For instance, the equations 
x-cos0, y—sinÜ (— œ< 0 <c) (8) 


specify a smooth plane curve. When 0 varies continuously from — œ to 
+ co the corresponding point (x, y) traverses infinitely many times the circle 


ety = | (9) 


Therefore equations (8) are termed parametric equations of circle (9). In 
this example the parameter @ has an obvious geometrical meaning: it is equal 
to the angle between the radius of the point (x, y) and the positive direction 
of the x-axis. 

The equations of circle (8) can be written more "economically": 


x= cos 0, y = sin0  (0-«0-«2a) (10) 


Here @ runs through the closed interval [0, 277]. Curve (10) is an example of 
a smooth closed curve not intersecting itself. The circle 7 understood as the 
locus of points (x, y) satisfying equation (9) is also usually said to be a closed 
curve. This should in fact be understood in the following sense: there exists 
a continuous closed curve without self-intersection represented parametri- 
cally (namely, curve (10)) whose moving point runs through the points of I 
and only through these points. 

C. Jordan proved the following proposition which is geometrically obvious 
while its rigorous proof involves some intricate considerations: a simple 
closed curve I lying in a plane R divides the set R—I' into two nonempty and 
nonintersecting regions one of which is the interior of I' while the other is the 
exterior of l: R—I' = A+A.. Any two points belonging to A; can be 
joined by a continuous curve lying entirely within A; and any two points of A, 
can be joined by a continuous curve belonging to Ae. Every curve connecting 
an arbitrary point of A, with an arbitrary point of A, has at least one common 
.point with T’ (intersects I’). The region A; is bounded; the region A, is ùn- 
bounded. 

It should be noted that the definition of a continuous curve is so general 
that there are examples of mathematical objects satisfying the conditions of 
this definition which are essentially different from a curve understood in the 
sense of our ordinary intuitive idea, especially when self-intersections are 
allowed. 

For instance, it was proved that it is possible to define two functions 


x = g(t), y= WD (0 — t1) 


continuous on the closed interval [0, 1] such that when the parameter £ 
continuously increases from £ = 0 to £ = 1 the variable point (p, (1), v(z)) 
moves in such a way that it starts from the position (0, 0) corresponding 
to ¢ = 0, runs through exactly all the points of the square 0 = x, y «1 
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and arrives at its right upper corner (1, 1) for ¢ = 1. Hence, this curve 
(known as Peano’s curve) literally passes through each point of the square 
0 = x, y = 1 (through some of the points the curve passes not once). 

In Fig. 6.1 we see a plane curve J’. Let us suppose that it is representable 
by continuously differentiable functions 


x=), y=), ¢?+yp"2>0, 01-1 


When ¢ increases continuously on the interval (0, 1) the point (x, y) moves 
along the curve J'starting from the point A, passes through the points B and 
C and again tends to B as t — 1. We see 
that in spite of the continuous differenti- 
ability of the functions y and «y the curve 
i has a singularity at the point B in the 
sense that the part of 7" lying within any 
rectangle 4 with centre at B, however 
small, cannot be projected in a one-to- 
one manner on any of the coordinate axes. 

If a smooth curve I’ is not “deficient” 
in this sense at its every point, that is 
if its every point can be covered with a rec- 
tangle 4 with edges parallel to the coordi- 
nate axes such that J'A (the intersection of Fig. 6.1 
I'and 4) is projected in a one-to-one man- 
ner on at least one of the coordinate axes, I’ is called a one-dimensional diffe- 
rentiable manifold. 

In§ 17.1 we shall prove Lemma 1 from which, as a special case, the follow- 
ing assertion follows: 

If a smooth curve I defined on a closed interval [a, b] by equations 





x= Pi), Y (p*-0 axt<b 
f=1 


does not intersect itself, that is if the points of T' and of [a, b] are in a one-to-one 
correspondence specified by equations of type (1) the curve I’ obtained from 
I by deleting both end points of the latter (I^ is defined on the open interval 
(a, b)) is a one-dimensional differentiable manifold. 


Example 1. The ellipse 7' determined by the equation 
ZtR=1  (eb-0 (11) 
is a bounded closed smooth curve not intersecting itself since 7' can also be 
described by the parametric equations 
x=acos#,y=bsn6 (0<0 <2) (12) 
which define a bounded closed smooth curve in the sense of the definitions 
of smoothness and closedness stated in this section. 


20006 — 13 
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Example 2. The astroid 7" determined by the equation 
Jax [284 jbyP® = (a9 (0 <b <a) (13) 


is a bounded piecewise smooth continuous closed curve because equation 
(13) is equivalent to the two equations 

x= E cost, y= E sin) (0 < 9 = 2) (14) 
and because there is only one pair of values of 0 (0 = 0 and 0 = 2z) to 
which there corresponds one and the same point of I’. Equation (13) shows 
that the curve J" is symmetric with respect to the coordinate axes, and (14) 
indicates that it is continuous. The derivatives of x and y with respect to 0 
are also continuous; they do not vanish simultaneously except at the points 
0, 2/2, x; and 3/2. Therefore the parts of I’ corresponding to the intervals 
(0, z/2), (77/2, zt), (zt, 37/2) and (32/2, 27) are smooth (see Fig. 6.11). 


§ 6.6. Geometrical Interpretation of the Derivative 
of a Vector Function 


Let us consider (ordinary) three-dimensional geometrical space with 
rectangular Cartesian coordinates (x, y, z). Suppose that in this space a 
smooth vector function (see p. 189) 


r(r) = (PA), v(),x(0), zE (ab) (1) 


is defined. The hodograph of the vector r = r(¢) is shown in Fig. 6.2; in the 
figure we also see the two 
points Aand Bwhich are respec- 
tively thetermini of the vectors 
r(t) and r(t+ Ar). 
It is obvious that the vector 
AB can be represented as AB= 
= Ar = r(t--Ar).—r(r. When 
At -- 0 the point B movesalong . 
the hodograph and tends to 
the point A while the secant 
passing through the points A 
and B tends to occupy the 
Fig. 6.2 position of a definite (limit- 
ing) straight line which is 
called the tangent to the hodograph at the point A. It follows that the limiting 
vector 





r= lim = 
ano 2 


(it is different from zero!) lies in the tangent line to the hodograph at the 
point A. The length | | of the vector F is equal to the limit of the length of the 
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ar n 
vector -y as At -- 0 since 


i-fl- 





. 4r 
i-o (dt — 0) 


If ¢ is time and the terminus of the vector r(r) describes the motion of a 
point, then F(t) is the vector representing the velocity of that point at time 
moment f. Its length |#| is the absolute value of thc velocity. The vector f 
determines the direction of motion of the point at the moment ¢. Further, 
the vector 7 is nothing but the acceleration of the point at the moment £. 

In $ 6.4 we discussed some properties of the derivative of a vector function. 
Here we state some further obvious properties. 

If (a, b) = a,b,-+ayby+<a-.b, is the scalar product and [@X4] = (ayb: — 
—azby, a:b, — Axb-, a,b, — ayby) the vector product of the vectors a and b 
then 


d db da ,' 
ur ®© b) = (a, mE b) 
and 
d m db da 
Glaxo) = [ex F] +E xt] 
We also note the following fact. Let a vector function b = b(t) have a 
constant norm (length): |(A)| = c = const > 0. Then 


(6, b) = 2(b, 4) =0 


It follows that the vectors b and s are mutually perpendicular for any ¢ 


Or f= 0orb=0. 
An arbitrary vector function a = a(t) whose length is positive for any 
value of 7 in question (la| > 0) can be written in the form a = xw where 


Loa _ (a) ax) axl) 
OO Tar Nr la] ’ iai ) 





and 
a(t) = la] = Yay +a Hai 

It is obvious that if the vector a possesses the derivative with respect to ¢ 

for the values of t under consideration then the functions œw and « also have 


derivatives for these ¢. The derivative of the vector a can be resolved along 


the two vectors o and a 


da da do 
uou terr (1) 


The first component E w in this resolution is directed along a or, which is 


13* 
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the same, along w and its length is equal to the rate of change of the length 


of a; the second component « A is orthogonal to w. This formula is used 


in mechanics for the resolution of the velocity vector of a moving point 
into two components one of which goes in the direction of motion while 
the other is perpendicular to the former. 


§ 6.7. Arc Length of a Curve 


Let I" be a continuous curve determined by equations 
r) = GO; vO, z(0) — (€ fa, b) (1) 


Let us break up the interval [a, b] into parts with the aid of points of 

division 

acto cti... xt =b (2) 
the corresponding points of the curve 7" being respectively Ao = A, Aj, ..., 
An—1, An = B. On connecting them in succession with line segments (see 
Fig. 6.3) we obtain a polygonal 
line inscribed in 7". 

By the length of the curve I’ is 
meant the limit to which tends 
the sum of the lengths of the seg- 
ments of this polygonal line when 
the maximum of the subintervals 
in the partition (2) tends to zero: 


| : n 
| 4B| = lim Y 144-144. 
1 





max (fx— ty —1) — 0 (3) 


Fig. 6.3 If limit (3) exists the curve I is 
» said to be rectifiable (on the in- 
terval [a, b] of the variation of the parameter 7). 
Let us suppose that the curve J" under consideration is smooth. This 
means that the functions p, y and x are continuous and possess continuous 
derivatives on [a, 5] satisfying the condition 


IF = eG v'GP--xG*-0 E [a b) (4) 


Later on, when studying the integral calculus, we shall prove that a smooth 
curve I is rectifiable on any interval of variation of the parameter ¢ and that 
the arc length of the curve I" possesses the additivity property in the sense 
that if Pı, P» and P; are three arbitrary points of /' corresponding to some 
values /1, / and £3 of the parameter and /1 < ft < fy then 





|P,Ps| = [ees] | PeP] 
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Let us introduce the new function s = F(r) equal to the length of the 


— 
arc AC corresponding to the variation of the parameter on the interval 
[a, £]. It will be proved in the integral calculus that the function F(f) possesses 
the following properties: it is continuous and has the continuous derivative 
on [a, b] determined by p formula 


F'(t) = 3 = Ve (y c v G7 > 0 (5) 


Besides, F(a) = 0. 1t follows that s is a strictly increasing function which 
specifies a mapping of the interval [a, b] of variation of t onto the corre- 
sponding interval (0, /] of variation of s and that its inverse function 


t= As) (Oss) 


exists, is continuous and has the continuous derivative 1'(s) > 0. 
We see that s can be chosen as one of the admissible parameters for the 
smooth curve 7" in question: 


x-q( As) y= »(A(s)), z= (A(s) (O=s</) 


Now let 7 be an arbitrary admissible parameter for the curve J’ connected 
with ¢ by means of a function ¢ = 2(r) possessing a continuous nonzero 
derivative. Then the sign of = = s. #'(t) depends on the sign of 2'(1) 
and hence, taking into account the formule for the derivative of a function 
of a function, we can write 


5 2 LOWE OFTE = LAO OFA © 
where 
= p(T) = G(A(z)), y = p(T) = p(A(r)) 
=n(t)= 740)  (v€(ed) (7) 


are the equations of I" written in terms of the parameter t, and the square 
root in (6) is taken with the sign “+” or *—" depending on whether s 
increases or decreases as T increases. 

It follows that 


ds = Xy dx? + dy? + dz? (8) 


If dr > O we should take the sign “+” in (8) in the first case (see above) 
and “—” in the second case. But if dz < 0 then, conversely, in the first 
case the sign *— " is taken and in the second case the sign “+”. 

If we put t = s in equality (6) then in front of the root on the right-hand 
side of (8) we should place the sign “+ ” since s regarded as a function of s 
is increasing; we thus obtain the equality 1 — (S)+(2) + (=). It 
should be noted that in these considerations we assume that s = O for 

= a and that s increases together with £. 
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The definition of the arc length of a curve stated in this section involves 
explicitly a definite parametric representation of the curve. But it can be 
shown (see § 10.3, formula (3)) that the are length is in fact an invariant 
independent of the choice of the variable t by means of which the curve is 
parametrized. 


§ 6.8. Tangent Line. Normal to a Plane Curve 


Let us consider a smooth curve determined by a vector function (r) = 
= (x, (f), y(t), z(0), t € (a, b) defined in the (ordinary, geometrical) three- 
dimensional space with rectangular Cartesian coordinates (x,y, 2) (see 

: Fig. 6.4). Suppose that the direction 
in which the arc length is reckoned 
is chosen so that it increases together 
with the parameter : (like in $ 6.7). 

Let us put ro = r(fo) = (Xo, Yo, 
zo) and Fo = F(fo) = (xy, Yo» zo). The 
vector řo goes in the direction of the 
tangent line to the curve atthe point 
fo and therefore the variable point 
o = (x,y,z) of the tangent (the 
tangent line) is determined by the 
equation 





Q = roc ifo (1) 


Fig. 6.4 


where u is an arbitrary number (a 
new parameter providing a representation of the tangent line). 
Equality (1) is the equation of the tangent line to the curve at the point ty 
written in vector form. 
It follows from (1) that in Cartesian coordinates the equations of the tan- 
gent are written as 


t , , 
X— Xo = ux, y—Jo = Wyo, Z—Zo = UZo 


. or, equivalently, "T 
X— Xo E y—J9o Z—Z9g (2) 


" na " = 
Xo Yo Zo 











Let us denote by «, f and y the angles formed by the positive direction 
of the tangent (i.e. the direction of ro) with the positive directions of the 
coordinate axes x, y and z respectively. Then, obviously, 


osa ee = (2) 
~ Tamara ^ dh 

cos fj = LÀ = (2) 
Vx tyez ds Jo 
IA mae 
Ju yxic-yBaid 7 \ds Jo 
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where (x) symbolizes that the 
« o 
value s= So corresponding to 
{= fs is substituted into Z, In 
front of the square root stands the 
sign “+” because we agree that the 
arc length increases together with 7. 
A curve lying in the xjy-plane can 
be treated as a special case of as pace 
curve with z(t) = 0. Therefore in 
the case of a plane curve relations 
(2) reduce to one equation 





AT Aos Lo Je 

Xo Yo 
Jn this case the positive direction of the tangent forms an angle x with the 
x-axis for which 


Xe ida : , 
D. T2 = (=) and sing = 2%. = (2) 
pro Ye PU) Vxg ys y/o 


For a plane curve we can also define the notion of the normal to the curve 
at the point tẹ which is a straight lire lying in the plane urder consideration 
and passing through the point of the curve corresponding to ¢ = to per- 
pendicularly to the tangert. For some problems it is important to define the 
positive direction of the normal specified by a (normal) vector N. It is chosen 
so that the direction along the tangent T corresponding to the increase of 
t and the direction of N form a rectangular system oriented like the coordi- 
nate axes x and y, that is it must be possible to make the angle formed by 
T and N coincident with the first coordinate angle by means of a continuous 
motion in the plane so that T goes along the positive > x-axis and N along the 
positive y-axis (Figs. 6.5 and 6.6). 





Fig. 6.6 
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Let 4 and u be respectively the angles formed by the positive direction 
of the normal with the axes x and y. It is seen from the figures that the 
convention we have made leads to the formulas” 


Ta ; (2) 
COS 4 = —SIn x = —|—— 


dx 
and cosu = cos« = (—— 
ds Jy 0 


ds 


§ 6.9. Curvature and Radius of Curvature of a Curve. 
Plane Curve. Evolute and Evolvent 


By the curvature of a circle of radius R is meant the number 1/R. This 
number can be expressed as the ratio of the angle (measured in radians) 
between the tangent lines drawn through the end points of an arc of the 

circle to the length of that arc. This property provides 

A an idea of a curvature which can be generalized to ar- 
bitrary smooth curves. 

a Let us consider a smooth curve I (Fig. 6.7). It is rec- 

tifiable, and the length of its arbitrary arc 4B makes 

g sense. The angle « (0 <a =x) between the positive 

directions of the tangent lines to the curve at its points 

A and B is called the angle of contingence of the arc 

AB. The ratio of the angle of contingence (measured in 

1 radians) of the arc AB to its length is called the 

Fig. 6.7 average curvature of the arc AB (see Fig. 6.7). The cur- 

vature K of the curve I’ at its point A is the limit (finite 

or infinite) io which tends the ratio of the angle of contingence x of 

the arc AB to its length |As|, i.e. the average curvature of the arc AB, as 

the latter tends to zero: 
K = lim — 1 

' ás-0 14s} ( ) 

Thus, 0 = K =œ. By definition, the quantity R = 1/K (here we agree 
that 0 = 1/2 and 1/0 =o) is called the radius of curvature of I’ at the 
point A. Me 

Note that the angle of contingence « (a = 0) of the arc AB is equal to the 
angle between the vectors (/) and #(¢+ At) = F-- AF where r(t) is the radius 
vector of the moving point of I" or, which is the same, to the angle between 
the unit vectors t(t) = r(7)/|/(r)| and «(t4- 47). Therefore the cosine of the 
angle is obviously equal to the scalar product (z(?), t(¢+ Jt) and the angle a 
itself can be written as 


x = arc cos (T(t), v(^--40)) — (0a «a) 


whence we see that, for a smooth curve, At — 0 implies x — 0. 


* To memorize these formulas note that the vector product of the vectors (0, 0. 1) 
and (cos a. sin a, 0) is expressed as (0, 0, 1) x (cosa, sina, 0) = ( — sin æ, cos a, 0). 
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According to what is known from vector algebra, 


: ]Ex + 47)| Fx AP | 2s : : 
= SO Ae = rl+40—-— 
sin = ^Tnrzr A FIRAT’ Aè = F(t+d)-K( (D 


because f Xf = 0. Here the denominator is different from zero since we have 
? # 0 for a smooth curve. When Jt — 0 the denominator tends to |?|? > 0 
while the numerator tends to zero. Let us consider the arc length s — s(/) 


along the curve in question. The length of its part AB is equal to 
lási = |s(t4- 47)— s(0)] 


From As - 0 it follows that At — 0 because ¢ and s are both admissible 
parameters for the smooth curve I’ (see $ 6.8). 

Let us suppose now that the radius vector r(t) of the smooth curve J" 
under consideration possesses the second derivative i‘(t); under this assump- 
tion we shall prove the existence of a finite curvature of J’ at the point 4 
corresponding to the value ¢ of the parameter. 

By virtue of (1) and (2), the curvature of /' at the point ¢ (i.e. at the moving 
point of the curve corresponding to the value ¢ of the parameter) is expressed 
by the formula 








edt 
K — lim A = lim P = lim Ar = 3) 
PS xs 4-9 JF] p AOI — 
Zt 
(see the explanations given below), that is 
K= L = SOXHON | Voz zy yy anu ATF REF gy 
R Jr? (tty SET 


In the third term in (3) we have replaced x by sin z under the sign of limit. 
This is legitimate because if the values of « corresponding to a sequence of 
values of As tending to zero are positive (x > 0) then sin « a: « (a > 0), 
and therefore Theorem 2 in $ 4.10 applies and if, beginning with a certain 
term of the sequence, we have æ =.0 then sing = æ = O for these values 
and the second equality (3) is again valid. 

If the parameter £ = s is the arc length of 7' then, as we know, |F(s)| = 1 
and the vector f(s) is perpendicular to /(s), and hence 


j ed 
K-|i(s) and R= Fel (5) 


In the case of a plane curve (z = 0) the expression of the curvature in 
terms of the coordinates is 


eo 
K = wry (6) 


If a plane curve is determined by an equation y — fi (x) where the function 
f possesses a continuous derivative with respect to x in a neighbourhood 
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of a point x and the second derivative of f(x) exists at the point x itself 
then, putting ¢ = x in the last formula, we obtain 

| dy 
| doe 


[GT 


(for the expression of the curvature in polar coordinates see Exercise | in 
$ 7.26). 

Let A = (x,f( x)) be a point of a curve T’. Consider the point O lying at 
a distance of R = 1/K from the point A of I' on the normal to T’ at the 
point A drawn in the direction of concavity 
of I’. This point is called the centre of curva- 
ture of T at the point A. 

The curve y serving as the locus of the 
centres O of curvature of a piane curve I" is 
termed the evolute of I". The curve P itself 
is called an evolvent (or involute) of y. 

In Fig. 6.8 we see a plane curve 7' on which 
the direction of increase of its arc length s is 
marked by an arrow. Here the second deriv- 
ative f/"'(x) is negative and therefore the rad- 
ius of curvature at the point A is equal to 





K- (7) 





Fig. 6.8 Ru IX (8) 


z 


The direction cosines of the tangent line (drawn in the direction of increase 
dx 

of 5) are equal to and a while the direction cosines of unit Horna 

vector v going from A in the direction of convexity of I are Na and ca 


ds s 
so that 7 
(od dx 

v=(-2, 3) (9) 

The coordinates ë and n of the centre of curvature O = (F, 7) of the curve 
I' at the point A are obviously given by the formulas 
& dy dx 

f= v R and = JUR (10) 


Relations (10) can thus be regarded as equations of the evolute. 
In the case when the curve I" is located and oriented as shown in Fig. 6.8 
we have y; < O and x, > 0. Therefore from the formula 


fall 

ye _ NYr— KX 

w meea 
x? 


it follows that the numerator of its right member is negative, and hence 
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ul 








see (6 
( ( )) R= (x? yy ir ES ne 
= Yx'-x»r^ 5, = (x; Ty)? (1 1) 


Consequently (10) shows that the equations of the evolute of the curve I’ 
can be written in parametric form as 


xety? xy 

t » , 1 1 m as TY 

= y= y, SC = y+, —!5 

i U x yx? gegen XOU = yup (12) 


It can be proved that these equations continue to hold for all the other 
possible locations and orientations of the curve relative to the coordinate 
axes. 

The two basic facts below are characteristic of the relationship between 
a given curve (evolvent) and its evolute: 

(i) The normal to the evolvent at its every point s coincides with a tangent 
line to the evolute. 

Indeed (see (11)), we have I/R = y;x;'—x;y; and hence property (i) 
follows from the fact that the tangent vectors to J‘ and y at the corresponding 
points are mutually perpendicular (see (10)): 


Msn = (PHIEN Xs V) REAY x) Re = 1- * R+0=0 


(ii) There holds the equality 
o cR (13) 
where R is the radius of curvature of J‘ at A and ø is the length of the arc 
of y joining O to an arbitrary fixed point of y, the points A and O being two 
points, corresponding to each other, of the evolvent /" and the evolute y 
respectively. The signs *--" and *— " depend on the direction of the reckon- 
ing of c. 
Indeed, we can rewrite equality (10) in the form, 
r~o = Rv 
where r and @ are, respectively, the radius vectors of A and O whence 


(r— 0, r— o) = R. On differentiating with respect to t (see the explanations 
below) we obtain 

RR = (r—o0, *—6) = —(r—@, 6) = — RIÓ| = = Ro’ 
which implies (13). 

The second equality in the above chain of relations follows from the fact 
that, by virtue of property (i) already proved, we have (r— o, P) = 0; the 
third equality is implied by the relation jr—9| = R and by the fact that the 
vectors r— and @ go in one direction; the fourth equality follows from 
l| = +6 where the sign “+” or *—" depends on the choice of the direction 
of reckoning c along the evolute. fs 
If, for instance, o increases together with ¢ then R' = — oa’ whence Í R'dx= 

la 
: á 
=— | o’ dt and, by the Newton-Leibniz formula, Ra— R4 = c;— 02 where a1 


f 
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and R, correspond to the value z; of the parameter and 
oand Rə correspond to the value 7». Thus, in the case 
under consideration the increase of the length of the 
arc of the evolüte results in the decrease, equal to the 
former, of the radius of curvature of the evolvent. 

Imagine that a flexible, inextensible string is 
stretched about the evolute. Now, let the string be un- 
wound, under tension, from the evolute. At every mo- 
mentin this process the string is tangent to the evolute 
and its free end point describes a curve which is noth- 
ing but an evolvent (Fig. 6.9). Since the string can 
be of arbitrary length the given evolute generates an 
infinite number of evolvents. 





Fig. 6.9 i ‘ 
Example 1. Consider the cycloid 
x= {f-sint, | y-1-—cost (14) 
The curve = ¢+sin /, 7 =—i+cos ! serves as its evolute. Putting 


t = t+7 we arrive at the ‘equations 
i—mx = t—sint, n+2 = l—cost 


We thus obtain the same curve (the cycloid) but shifted relative to the original 





Fig. 6.10 Fig. 6.11 


curve; thus, an evolute of the cycloid is a cycloid congruent to the former 
(see Fig. 6.10). 


Example 2. As an evolute of the ellipse x = acost, y = b sin t (a= 
= b > 0) serves the astroid (Fig. 6.11) 


sin? ¢ 





ab? 
f= Bs as cos? t, =- 


(see § 6.5, Example 2). 
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§ 6.10. Osculating Plane and Moving Trihedron 
of a Curve 


By the osculating plane of a curve I" at its point A is meant the limiting 
position of the plane passing through the tangent line to I’ at the point A 
parallel to the tangent drawn through another point B of the curve as the 
latter moves along the curve tending to 4. 

Let us show that if a curve r(f) has the continuous derivative # in a neigh- 
bourhood of a point fo and, besides, if the second derivative #(fo) at the 
point fo itself is such that 


ho X¥o = F(fo) X#(to) = 0 


then the osculating plane of the given curve at the point £ = fp exists and is 
described by the equation 


(o— ro) [Fo X?o] = 0 (1) 


where g is the radius vector of the variable point of the osculating plane. 
To this end we consider the increment of £(r) at t = to: 


Ay = F(to+ Ar) — F(to) 


The vector tox re. = # (to) x foro 
vectors F(fo) and F(fo+ Ar) applied at the point ÆA and, consequently, to the 
plane passing through them. Since this vector tends to the vector 
FXFo = O as At — O the indicated plane tends to occupy the position of the 
plane passing through A perpendicularly to fo X#o; therefore this limiting 
plane is nothing but the osculating plane of J’ at A, and its equation is 
obviously (1). 

There is also an alternative definition of the osculating plane: the osculating 

plane of a curve I at its point A is the limiting position of the moving plane 
passing through the point A and two other points A, and As (A, # A2) of 
the curve I (distinct from the point A) when the latter points tend to A moving 
along T. 
It can be shown that under the requirements imposed above on r(f) in 
the neighbourhood of fo there exists the osculating plane of £ at the point 
t = to in the sense of the second definition as well and itis determined by 
equation (1). Thus, it coincides with the osculating plane understood in 
the sense of the first definition. 

In Cartesian coordinates equation (1) is written in the form 


is orthogonal (perpendicular) to the 


X—Xo y-—yo 2—Zo 
Xo Yo zy |=0 (2) 


[44 


x ^ 5 mj 
where x, y and z are the coordinates of the variable point of the osculating: 


n 


plane, ro = (xo, Vo, zo), fo = (Xos Yo» Zo) and Fo = (xy, Jo Zo )- 
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The vectors £f and # issued from the point A = (x, y, z) are obviously in 
the osculating plane S at A. If ¢ = s is the arc length of T then f(s) is unit 
vector and the vector F(s) is perpendicular to 7(s). 

From the moving point A of the curve under consideration (satisfying 
the conditions imposed) we can issue the following three unit vectors c, p 
and ? determining the so-called natural rectangular coordinate system in 
the vicinity of A: 


a= a = F(5) which is the unit vector of the tangent 


LOK _ per.) _ p 4% which is the unit vector of the so- 
pr IL RS) EE called principal normal G) 


y — ax which is the unit vector of the so- | 


called binormal. 


It should be noted that the direction of a depends on the parameter ¢ 
in the sense that the replacement of £ by — + changes the direction of « to 
the opposite. 

As to the vector fj, it is defined by means of the parameter s which is the 
arc length of 7". The replacement of s by — s or by s+ so where so is a constant 
does not lead to any change in f(s) (since the differentiation is performed 
twice); therefore B is an invariant: its direction is not connected with the 
parametrization of a curve. 

By a normal to a curve l' at a point A we naturally mean a straight line 
passing through the point A perpendicularly to the tangent to f° at that 
point. Among these normals there is exactly one belonging to the osculating 
plane S (of the curve T at the point A). It is called the principal normal. 
The vector i(s) is obviously in the plane S and is perpendicular to the tangent 
and therefore lies in the principal normal. It is convenient to agree that the 
vector F(s) or, which is the same, the vector B determines the positive direc- 
tion along the principal normal. We can also say that f is a unit vector 
issued from the point A, lying in S and directed toward the concavity of the 
curve I" (more precisely, of its projection on S). 

Let us lay off from the point 4 a vector of length. R (R is the radius of 
curvature of I at A) in the direction of B. Its terminus O is then called the 
centre of curvature of I' at A. In the case of a plane curve I this definition 
coincides with the one stated in $ 6.10 for the centre of curvature of a plane 
curve. The centre of curvature O is obviously determined by the vector 

. - F(s) 
e-rtRB-rtg 
(see § 6.10, formula (5). 

Finally, the vector Y is defined asa unit vector perpendicular to a and f 
and directed so that the triad (a, B, Y) is oriented like the Cartesian coordi- 
nate system (x, y, z) in which the given curve is considered. 

The straight line in which the vector ? (applied at the point .A) lies is 
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called the binormal of I’ at A. The vector Y determines the positive direction 
along the binormal. 

The three vectors a, f and 7 applied at the variable point A of the curve 
P form the so-called moving (or natural) trihedron of I. 

In the case of a plane curve the normal to the curve defined in $ 6.8 
obviously coincides with the principal normal (on condition that (s) + 0). 
At the same time the positive directions along these lines (along the normal 
and along the principal normal which coincide in the case of a plane curve) 
were, respectively, defined in § 6.8 and in the present section on the basis 
of different principles and therefore they may not coincide. 

To investigate the behaviour of the vector r(s) in the vicinity of a point 
So it is convenient to consider the difference r(s)— r(so) in the rectangular 
coordinates determined by the unit vectors œ, B and Y. 

Let us assume that r = r(s) where s is the arc length of J" and that ro = 
= r(so) is the radius vector of the point Ao € /' in whose vicinity the be- 
haviour of I" is studied. : 

Then a, B and Y are functions of s. From the equalities Ya = 0 andy = | 


it follows that the projections of o on the directions of a and 7 are equal 


to zero: 
dY x da _ i E ! 
ds > we c ESO $Y = 
Therefore 
dy — d 
"ds UT p (4) 
where 
| _ dy , 
T — ds P (5) 


The number 1 /T is called the torsion (or the second curvature) of I at the 
point A € I’ under consideration. It is obvious that it can also be defined 


as a number whose absolute value Iri is equal to |Z, that is to the rate 
ofchange of unit vector of the binormal relative to s. As to the sign of 1/T, 
it is positive or negative depending on whether the projection of p4 on the di- 
rection of B is positive or negative. 
Now we write down the so-called Frenet-Serret* formulas: 
da _ B dy _ 8 dp a y (6) 


ds R?’ ds T^ d — R T 


The first two of them are already proved (see formulas (3) and (4); the 
third formula is derived as follows. On differentiating the identities Ba = 


* J. F. Frenet (1816-1900) and J. A. Serret (1819-1885), French mathematicians. — Tr. 
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= YB = 0 and BB = 1 with respect to s we obtain 


dp da — 1] dy  gady . 1 , dB p _ 
Fea baa ze qs em B3 T and 14, 870 
Consequently 


ae er 8) 8+ (22)? = RF 
From (6) it follows that if the curvature of I’ is identically equal to zero 
(I/R = 0) then sa = 0 whence we conclude that r(s) = r(so)+ (s— so) (So), 
that is I’ is a straight line. If the torsion of T is identically equal to zero 
(1/T = 0) then 2 = 0, (Yr) = Ya+ yr = 0 and Yr = const; hence, in 

this case I’ is a plane curve. 

Example 1. The screw line (circular helix) I’ determined by the equations 

x = acos, y= asin, z= h0, (a, h > 0) 
has the arc length s whose derivative with respect to 0 is = = 


Xo +yert+ +15 = V&+h?. Therefore the unit vector « of the tangent 
to r has the projections 











dx 
dx — d? — ^ asinO dy _ accost d dz __h — 
ds ds yaik? ds Your ""° Cds — yai 

d0 

Further, we have 

dx _ a cos 6 dy — —asin0 d'z =0 








dt ^ Et dê a? dF 


K = |ř| = = — cos Üi— sin 0j-0-k 


a 
mue P= 
which shows that the principal normal of I" is parallel to the xy-plane and 
goes in the direction toward the axis of the circular cylinder around which 
the screw line is wound. Finally, 














hsin 0 1 cos 0 . a k 
Vath Yash?” vat 
ind. 

Os OM. i4 19957 540k and =p- 


ds qain ath zan 


Let us suppose that r(s) possesses the continuous derivatives up to the 
third order inclusive in a neighbourhood of a point s = so. Then we can 
write Taylor’s formula 


SO n ST 744 0f(s—s0)) (6 + 50) (D 





r—¥o = (5— So) Žo + 
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in which the remainder is a vector whose length tends to zero faster than 
jS— Sol? when s — So. 

Since the unit vectors 
Fo 
Fol 





ac Beg sd Y=axp (F0) 


are pairwise mutually orthogonal we have the equalitics 
r(s)— r(so) = A(s)at u(s) B+ v(s)v (8) 
A(s) = (r— ro, p H(s) = (r—ro, B), (5) = (r—ro, y) 


A'(so) = £- fo, e). = (F(s), a) |. e Pu (9) 
(so) = A £) = 0, 1"(s0) = (fo, 8) # 0 (10) 
v'(so) = v"(so) = 0, — v'""(so) = (F(50), Y) = (11) 


The last condition that »'""(sg) + 0 has been introduced additionally. Usually 
it holds (the case »’’’(so) = 0 can be regarded as exceptional). 

If we look at the curve J" in the direction of the binormal we see the pro- 
jection T, of F on the plane of the vectors a and £ (the osculating plane), 
the equation of the projection being 


(r — ro), = A(s)a- p(s) B 


By virtue of properties (9) and (10), the curve I’, has the tangent T at the 
point Ag, and in a sufficiently small neighbourhood of Ap it lies entirely 
either above T or below T (Fig. 6.12). 





N 
Fig. 6.12 Fig. 6.13 


1f we look at J" in the direction of the tangent we see its projection I’, 
on the plane of the vectors 6 and ?*, the equation of the projection being 
(r— Fo) = p(s) B+ »(s) Y. Hence, I, is determined by the equations 


n= pws) t-w) (2) 


* This is the so-called normal plane of I’ at the point A. — Tr. 
20006— 14 
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where (n, €) are the rectangular coordinates connected with the unit vectors 
p and ¥. 
By (10), we have 


n= STAR n'"(so)2O((s—se) — (s so) 


and by virtue of (11), 


oe eu -Y"(so)--o((s—soy) (s so) 


Thus, for small | $5— so| the sign of 47 = a(s) is retained and is independent of 
the sign of s—so. We also have 
= lin we) rU) | 


(£), = tin MM 
di) | o7 s— 59 AE s 5-59 Dg rao) w "ZU 


and the sign of £ = »(s) varies together with the change of the sign of the 


difference s— so; hence the curve (12) has a cuspidal point at the origin of 
the coordinates (7, 4) (see Fig. 6.13; also see $ 7.23). 


Fig. 6.14 


Finally, if we look at J” along the principal normal we see its projection 
I, on the plane of the vectors a and 7*, the corresponding equation being 
(r—rog = A(s)at (5)¥ 
By virtue of (9) and (11), the curve 5 = 2(s), ¢ = p(s) possesses the properties 


(4) _ Y'(so) 0, (5) = A'(59) (So) — A" (59) (So) 


dE Jo ^ FS) — dE Ts =0 


and 
(2), - rove 


This shows that the curve I’; has a point of inflection at Ao (Fig. 6.14). 








* This plane is called the rectifying plane of I’ at A. — Tr. 
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8 6.11. Asymptote 


Let us consider a curve (or a branch of a curve) J" determined by an equa- 
tion 

y — f(x) (x > N) (1) 

where /(x) is a function continuous for any x — N. The variable point 


A = (x, f(x) of this curve can then be regarded as being dependent on x. 
Besides, let there be a straight line L specified by an equation 


y = ax+b (2) 


where « and b are constant numbers. If the distance from the variable point 
A of the curve to the line L tends to zero as x increases indefinitely the line 
L is called an asymptote of the curve I (corresponding to x — + =). 

Now, let L be the asymptote of I for x —+ œ. The equation of L in 
normal form is written 


y-ax-b = 
yi-é 
Therefore the distance from the point A = (x, f(x)) of the curve J’ to L is 


equal to o(x) = |/(x)—ax—b|/l/1-- à?. By the hypothesis, Lisanasymptote 
of I’ for x — + œ, and therefore lim (x) = 0 whence 





x— +o 
lim [f(x)—ax—b] = 0 (3) 
x— e 
Consequently lim [2 -a-2] — lim [2-4] =0, ie. 
X-—9 dco i x— too 7 
tim D) a (4) 
X- +00 x 


What has been said provides the following rule for finding an asymptote of 
L for x + + œ. We must begin with computing limit (4). If it does not exist 
the asymptote of 7" for x — œ does not exist either. If limit (4) exists and 
is equal to a finite number a we must compute the limit 


lim {f(x)—ax} = b (5) 
x— 4o 


If limit (5) does not exist the curve I’ has no asymptote for x —-+ æ. If it 
exists the constants a and b thus obtained determine the straight line y = 
= ax+b which is the sought-for asymptote of I’ for x ~ + æ. Since limits 
(4) and (5) are unique (provided they exist) the continuous curve (or a 
branch of a curve) specified by equality (1) either has no asymptote for 
X — + œ or possesses a unique asymptote of that kind. 

An asymptote is defined analogously for the case x —— «o when a 
continuous curve (or a branch of a curve) is defined by an equation 


y-fQ() (x-«-N) (6) 
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The notion of an asymptote for x — œ of a curve 
y= (Neix) -— (7) 


(consisting of two branches corresponding to x > N and x -<—N) is 
treated similarly (in the arguments above we should take x — — œ in 
Case (6) and x + œ in Case (7)). 

Ifa curve (or a branch ofa curve) J’ is represented by an equation y = f(x) 
(a = x < b) where f(x) is a continuous function on an interval (a, b) 
possessing the property that lim nf (x) = + œ. it is natural to call the straight 
line x = a a (vertical) asymptote of I’. Usually the line x = 4 is called an 
asymptote of I’ if the continuous function f(x) tends to infinity as x > a 
and is strictly monotone in a left-hand or right-hand (or both) neighbour- 
hood of the point x = a. In such a case the curve I’ can be represented by 
an equation x = p(y) where y is positive or negative and is sufficiently large 
in its absolute value, and then the straight line x = a can obviously be 
interpreted as an asymptote of I’ in the sense indicated at the beginning of 
the present section. 


Example 1. Let us analyse the shape of the graph /' of the function 
f(x) = lxve. 


We have lim fe) . lim (= LE RIT) = J. But in the case x — 


I> +m X— te 
— — œ the limit of this ratio is equal to + oo. 
Furthermore, we have lim [/(x)— x] = 0. Hence y = x is the asymp- 


X= +o 
tote of I’ for x + + œ. The straight line x = 0 is also an asymptote of £ 
for x tending to 0 from the right and from the left: 


lim f(x) =+e and lim f(x) = — = 
x>0 pe 


The roots of the equation f'(x) = 0 cannot be found analytically. At the 
same time it is evident that 


SQ) =e (>) 
lim f(x) 2— 9» and lim f(x)=1 


x--04-0 X= +00 
Thus, f'(x) is strictly increasing on (0, Œ=) and there exists exactly one 
value xo > O for which f’(xo) = 0. The function /(x) obviously decreases 
on (0, xo) from +œ to f(xo) and then increases, its graph having the 
asymptote y = x for x —4- and lying entirely above the latter. 
On the interval (— æ, 0) we have 


f=- 
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because -1e < 0 and 1—e7* <0. Taking this into account we readily 
see that f(x) is strictly decreasing on (— œ, 0) from + & to — œ., Further, 
we have 


fF") = ate, f"(x)2 mn e-* «0 on (— »,0) 


lim f"x)=+e and lim f" =- ~ 


Vee ao x—0, X-«0 





Fig. 6.15 


Therefore there is exactly one point x1 on (— ee, 0) at which the graph of 
f(x) has a point of inflection. On (— e, xi) the graph of fis convex down- 
ward and on (x, 0) convex upward (see the schematic graph in Fig. 6.15). 


Example 2. The curve y = Vx (x = 0) has no asymptote because, although 
the limit 
tim I Z9 
S X— Foo x 


lim (/x-0-x) =< 


X-— +o 


exists, the limit 


is not equal to a finite number. 


§ 6.12. Change of Variables 


Let y be a function of x and x = g(t) be a gen aneus of r. Then y 
is a (composite) function of £. The derivatives r1 r^ ... Of y with re- 


2 alee dy dy ‘ 
spect to x are expressed in terms of the derivatives 757, z> --.andinterms 
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of the known derivatives 2 T=? "(t y e e = p(t), ... according to the for- 
mulas (see $ 6.5, formulas (5) and (6)) 
dy 
2- de S20 (1) 
di 
and 


dx dy dy dx 
dy — dt dé dt dE 


déc (4) 
dt 

A more complicated situation arises when it is necessary to express the 

dy dy dv dv e B 

derivatives —— dx? der . in terms of —— dr de? Sere D) z A(y) and x = 

= p(t) are given functions. In this case the function A(y) is supposed to 
have the inverse function (y = 2—1(v)). 

It is obvious that 


Q) 


dy dv dy dx 
de qr d d (3) 
whence 
dy dv 
NEC aT TS 
de du "n 
dt 


and we thus have Mp) - in terms of D and the given functions 


of v and t. 
On differentiating (3) with Po to t we obtain 
dy {dv ‘dtu dx dy d*x 
ar ) rr um - m n D dx dE (5). 


Now, replacing in (5) by (4) and in the resultant equation with 


dv dv 


respect to 5 ay ; We arrive at the expression of = T in terms of — ar? ade an nd 


the known functions of v and f. 


r4 we should differentiate (5) with respect to z, replace 


; by the jan already found and solve the resultant equa- 


To obtain 
dy a 
dx and 


tion e CBS to 22; . The same technique is used for the computa- 





tion of higher-order me a. ee 


CHAPTER 7 


Differential Calculus. 
Functions of Several Variables 


§ 7.1. Open Set 


Let us choose an arbitrary point x" = (x1, ..., x9) in the n-dimensional 
space R, = R. By a closed sphere (or a closed ball) of radius r > 0 with 


centre at the point x? is meant the set of points x = (x1, ...,x,)€ R 
12 


satisfying the inequality |x— x?| = xe <r, 


j 1 

By an open sphere (or an open ball) of radius r with centre at x? we shall 
mean the set of points x for which the strict inequality |x— x?| = r is ful- 
filled". 

A closed rectangle in R (or, which is the same, a closed rectangular 
parallelepiped in R) is a set of points x € R whose coordinates satisfy in- 
equalities a; = x, = b; (a; < bj; j = 1, ...,n). In the case n = 3 this is a 
real rectangular parallelepiped with faces parallel to the axes of the rectan- 
gular Cartesian coordinates (x1, xs, xs). 

We can also define an open rectangle in R as a set of points x satisfying 
strict inequalities a; < x; < b; (j — 1, ..., n). 

A set of points x whose "coordinates satisfy inequalities Ixi— x9 <a 
(j= 1, ..., n) where a > 0 is a given number is naturally called a (closed) 
cube in R with centre at the point x? and side of length 2a. For n = 3 this 
is of course an ordinary cube with faces parallel to the coordinate axes of 
the (Cartesian) rectangular coordinate system (x1, X2, xa). 

oe an epe cube (in R)is defined by means: of: ‘inequalities [xj— x <a 
Gj=1, 


n 12 
The obvious inequalities [xj-x]| = (Y Gj—3Y| <r G-L...7) 


1 
mean that if a point x belongs to a ball of radius r with centre at x? it also 
belongs to the cube with side 2r and centre at the same point. Thus, the cube 
with side 2r and centre at x? entirely contains the ball of radius r and centre at the 
same point. On the other hand, if a point x belongs to a cube |x,—x}| <a 


* Here “sphere” is meant in the sense of a solid sphere (or ball). The confusion with 
"sphere" understood in the sense of a spherical surface can always be avoided by the use 
of the adjectives “closed” or “open”. — Tr. 
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E . . . R 1/2 f. . 
(j= I, ..., n) it satisfies the inequality (x (yy) < yna showing 
1 


that the ball of radius aYn and centre at x9 entirely contains the cube with 
side 2a and centre at the same point (see § 6.2 (12)). 

We have considered open balls and cubes; the same argument applies of 
course to closed balls and cubes. 

Let us consider an arbitrary set E of points x € R. By definition, x? is 
called an interior point of the set E if there is an open ball with centre at that 
point entirely contained in E. Here “ball” can be replaced by "cube" 
since every ball contains a cube with the same centre and vice versa. 

A set is said to be open if all its points are interior points. This definition 
can be stated alternatively as follows: a set E is open if the fact that a given 
point belongs to it implies that it is an interior point of E. 

It follows that an empty set is an open set. 

An open ball 

Ix-x?| <r (1) 


is also an open set. Indeed, let y be a point belonging to the given ball, i.e 
iy—x°| = o < r, and let x be an arbitrary point belonging to the ball 


lx-yl<e (€<r-—g) (2) 
For this point we have 
|x—x°] = [x-y +y’ | = [xyli +y] = eto <r 


which shows that ball (2) is contained in ball (1). 

Let the reader prove that an open rectangle and, in particular, an open 
cube are open sets. i 

The intersection G1G» of two open sets G1 and G» is an open set. Indeed, 
let a point x? belong to GiG2. Since x? is an interior point of both G; and G» 
there exist two concentric open balls with centre at x? one of which belongs 
to G; and the other to Ge. Their intersection is obviously an open ball 
(coinciding with the smallest of them) belonging to GiG2. 

It is readily seen that the sum (union) of a finite or countable number of 
open Sets is an open set. But it should be stressed that the intersection of a 
countable number of open sets is not necessarily open, for instance, the 
intersection of the open balls |x| < 1/k (k = 1, 2, ...) is a single point 
(the origin). 

By a neighbourhood of a point x? € R, is meant an arbitrary open set 
containing that point. It is obvious that the intersection of iwo neighbourhoods 
of x? is again a neighbourhood of x?. 

What has been said allows us to restate the definition of an interior point 
of a set E: x? is an interior point of E if there is a neighbourhood of x? belonging 
to E. Indeed, if x° is an interior point in the sense of the first definition then 
there is an open ball with centre at x° belonging to E; such a ball is a neigh- 
bourhood of x? contained in E. Conversely, if x? is an interior point in the 
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sense of the second definition there exists a neighbourhood of x°, belonging 
to E, which contains an open ball with centre at x° since this neighbourhood 
is an open set. 

In our course we shall deal with many examples of open sets defined in a 
strict mathematical manner but now, using solely the geometrical intuition, 
we can roughly say that if the boundary of a geometrical object is deleted 
from it the resultant object is an open set. 

In the sections that follow we shall deal with functions f! (x) — fn --., Xn) 
of n variables xj, ..., x, or, which is the same, of the point (n-tuple) x= 
= (xi ..., Xn), defined on open sets in the n-dimensional space R;. 

A set E is said to be (arcwise) connected if its any two points x’ and x” 
can be joined with a continuous curve entirely lying within E, that is if there 
exists a continuous vector function x = x(/), O = t = 1, such that x(0) = x’, 
x(1) = x” and x(t) € E (see8 6.5). 

By a line segment x'x^' is meant the curve with parametric representation 
x(t) = tx' +0 —1) x", t € [0, 1], which is obviously a continuous curve 
connecting x’ and x” 

A set E is said to be convex if together with its any two points x’ and x” 
the entire line segment connecting them belongs to E. See the examples at the 
end of § 7.3. 


Remark 1. A cube 4 with side 2d (d > 0) in R, can be defined by means of 
inequalities of the form 


= (aj x sb; j= 1, uH) 


where b;— a; = 2d (j= 1, ..., n). It is easily seen that 4 can be represented 
as the union of 2" cubes of the form (A; = xj « pj; j = 1, ..., n) where 
we put Àj = Ay Bj = (aj4- b;)/2 or Àj = (a; +6,)/2, Bj = b; in all the possible 
combinations. In this case we say that the cubed is partitioned into 2” equal 
(congruent) cubes with edges of length d. 


Remark 2. A cube in R, defined above reduces in the case n = 3 to an 
ordinary (three-dimensional) cube with edges parallel to the coordinate 
axes. The general definition of an n-dimensional cube involves the introduc- 
tion of orthogonal transformations of coordinates of the form . 


"n 
xx = Y ene 


kal 
n 
where x? = (3$, ..., x2) € R, and aj, are real numbers for which Y a5, =1 
k=l 
and > one. = 0 (i + j; i, j = 1, ..., n). For example, by a closed cube 


Ain "R, with centre at x? € R, and sides of length 2d is meant a set of points 
x € R, which turns into a set of the form {|&| =d; k = 1, ... n) after an 
appropriate (dependent on A) orthogonal transformation of coordinates. 
Similar remarks should be made for n-dimensional rectangles. 
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§ 7.2. Limit of a Function 


A function f(x) = f(x1, ..., Xn) is said to have a limit at a point x? = 

= (x9, ..., X?) equal to a number A and designated as 

lim f(x)= lm (Xn ..., X) =A 

a eae (1) 

Q1, ..., n) 

(also written f(x) — A, x — x") if the function is defined in a neighbourhood 
of the point x? except possibly at that point itself and if for any sequence of 
points x^ (k — 1, 2, ...) belonging to this neighbourhood, different from 
x? and tending to x? (see § 6.3), there exists the limit 


lim f(x*)= A (2) 


| x£—x91—0 
xk x9 


Another equivalent definition reads: a function f has a limit at a point x? 
equal to A if it is defined in a neighbourhood of x? except possibly at the 
point x? itself and if for any « > O there is ô > O such that 


If(x)—Al < € (3) 
for all x satisfying the inequality 
0 < |x—-x?| < ô (4) 


Inequality (4) in this definition can be replaced by 


0< Y |x=]! < ô (j=1,...,n) 
j=1 
In other words, given any « > 0, there is a neighbourhood U(x?) such that 
inequality (3) holds for all x = x? belonging to this neighbourhood. 

The proof of the equivalence of the first and second definitions for the 
general case of dimension n is analogous to the proof given in § 4.1 for the 
one-dimensional case. 

"Now we state Cauchy's criterion for the existence of limit (which is proved 
like in the one-dimensional case; see$ 4.1, Theorem 5). 

‘For à function f to have a (finite) limit at a point x? it is necessary and 
sufficient that for any £ > O there exists a neighbourhood U(x?) of the point 
x? (in particular, a cube or a ball with centre at x°) such that the inequality 


f(x) — f(x) « € 


holds for all the points x, x' € U(x") distinct from x?. 

If a number A is the limit of f(x) at a point x? then obviously A serves as 
the limit of the function /(x?-- A) of the argument A at the point » = 0!, 
that is pm S(x°+h) = A, and vice versa. 


Let ds s consider a function f defined at all points of a neighbourhood of a 
point x? except possibly at the point x? itself, an arbitrary vector œ = 
= (1, ..., Wn) of unit length ({@]| = 1)and a scalar ¢ = 0. The collection 
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of the points of the form x°+ fc (0 = 1) is spoken of asa ray issued from x? 
in the direction of the vector w. 
For every « we can take the function 


S+ 10) = fd tons ..., M+ oos) (0 « 4 =< Ön) 


dependent on the scalar variable /, the number à, being dependent on o. 
The limit of this function (of one variable r) as £ — 0, provided it exists, 
will be called the limit of f at the point x? in the direction of the vector œ: 
lim f(x°+/w) = lim AO, way XIE lon) 
1—0, 1>0 1—0, (>0 

in particular, if œ is the unit vector ej = (0, ..., 0, 1, 0, ..., 0) of the 
Xj-axis we can speak of the limit of f at the point x? in the direction of the 
positive x-axis, that is 

lim f(x°+te/) = lim SOP, ones oa PEL Mey M) 


t—0 
1-0 ine 


or in the direction of the negative x-axis: 


lim f(x9— tei) = lim f(x], ..., Xp M — Paty «+ +2 XD) 
1—0 tt 
(1-90 t-0 


If a function f has a limit equal to 4 at a point x" then obviously it has a 
limit at this point in any direction and all these limits coincide with the former 
limit. The converse is not true: in the general case a function can have a 


limit at x? in any direction equal to one and the same number 4 and at the 
same time it can have no limit at x9. 


Example 1. Let us consider the two functions 


O Soy) = SD. and (i) s) LA 


The functions f and g are defined throughout the xy-plane except at the . 
origin (0, 0). We have 


2( 2. pty? 
- 2(x*-- y") 


f(y) = Ey 7 2(x2 + y2yi? - 
whence 
lim f(x,y) = 
x, yd 
(for > e > Owe put ô = £/2; then j f(x, y)| = e provided that (x°+y’)” < 
< ĝ 


As for the function g(x, y), taking an arbitrary constant number k we 
obtain 


is 


l-k 
P(x, kx) = Trk 





ws 
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whence follows that the limits of p at (0, 0) in different directions are, 
generally, different from each other, and therefore the function y has no 
limit at (0, 0). 


Example 2. Let us consider the spiral in the xy-plane described by the 
equation p = 0 (0 < 0 = 2x) where g is the polar radius of the moving 
point (x, y) and 0 is its polar angle. Let us take the function y(x, y) defined 
by means of the following rule (see 
Fig. 7.1): 


y(0,021, v(xy)-0 for 
o=Vx+yr=0>0 


and y is a linear function on any line seg- 
ment connecting the point (0, 0) with the 
variable point of the spiral. 
It is readily seen that lim y(tx, ty) = 1 
t-+0 


for any point (x, y) z (0, 0), that is the 
limit of y at (0, 0) in any direction exists, 
whereas the limit of p at (0, 0) does not 
exist. For, if the variable point (x, y) ap- 
Fig. 7.1 proaches the point (0, 0) along a curve 
lying between the spiral and the x-axis in 

the first quadrant of the xy-plane, then y(x, y) = 0 along this curve. 
We shall write lim f(x) = œ if the function f is defined in a neighbour- 





x— x0 
hood of x? except possibly at x? and if, given any N > 0, there is 6 > 0 such 
that | /(x)| > N when 0 < jx—x?| < ô. 
We can also introduce the notion of the limit of f for x + —: 


lim. f(x) = A (5) 


For instance, if A is a finite number, equality (5) should be understood in 
the sense that, for any £ > 0, there exists N > 0 such that the function f is 
defined at all the points x for which |x| > N and that the inequality 
| f(x)— A| < e is fulfilled for such x. 

There hold the equalities 


lim. (/()9(2)) = lim f (x) + lim, (x) (6) 
lim (f(x) e(x)) = lim f(x) lim g(x) (7) 
x x0 x x9 x— x0 


and 


rey jme 
_ ox-ux* * 
eene 9U) Tim ee) [Hn 9Q) = 0) (8) 


z=: 
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where, in particular, there can be x? = œ. As usual, these relations mean 
that the (finite) limits on their left-hand sides exist if the limits of f and ¢ 
exist. As an instance, let us prove (7). 

Suppose that x* — x" (x* = x"); then 


lim (f(x*g(x*) = lim f(x*) lim q(x*) = lim f(x) lim q(x) (9) 
xb x9 xb. x9 xk—e x0 Xm x0 x— xo 


Hence, the limit on the left-hand side of (9) exists and is equal to the right- 
hand member of (9), and, since the sequence {x*} has been taken quite 
arbitrarily, this limit is equal to the limit of the function fi (x) p(x) at the 
point x?. 


Theorem 1. [fa function f has a nonzero limit at a point x*, that is 
lim f(x) = A #0 
x--x90 


then there exists 6 > O such that for all x satisfying the inequalities 

0 < |x= x] <6 (10) 
the given function satisfies the inequality 

ifi i4li2 (11) 


and the sign of f (x) coincides with that of A for these values of x. 
Indeed, putting € = | A|/2 we can find 6 > 0 such that the inequality 


iJ (x)— Aj < | Al/2 (12) 


is fulfilled for all x satisfying inequalities (10). Therefore we have | 4|/2 > 
> |A—f(x)| = |A|—-|/(x)| for such v's, i.e. inequality (11) holds. 
For the indicated x it follows from (12) that 
a-l «p «a UI 


2 


that the signs of f(x) and A coincide. 


Remark. In $ 7.10 we shall state a more general definition of the limit for 
a function defined on an arbitrary set. 


§ 7.3. Continuous Functions 


A function f(x) = f(o1, ..., Xn) is said to be continuous at a point x" = 
= (x9, ..., x9) if it is defined in a neighbourhood of x? including the point 
x? itself and if the limit of the function at the point x? exists and is equal to 
the value of f(x) at x?: 

lim. f(x) = f(x?) (1} 
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The condition of the continuity of fat x? can be rewritten in the equivalent 
form 
Jim f+) = S°) a? 
h—0 


This means that the function f(x) is continuous at the point x" if the function 
S(x®+A) of the argument A is continuous at the point k = 0 (and vice versa). 

We can also introduce the notion of the increment of f at the point x? 
corresponding to the increment h = (hi, ..., ha) of the vector argument 
xX = (xy... Xn) by putting 


MSO = f? 8) — f) 
and restate the definition of the continuity of f at x" in terms of the incre- 
ments: (he function f is continuous at x" if 


lim 4,/() = lim [fth ..., x H-h)—f (0$... 2] = 0 
h--0 nsu 0 
(1") 


From formulas (6)-(8) of § 7.2 we directly deduce the following theorem. 


Theorem 1. The sum, the difference, the product and the quotient of two 
functions f(x) and p(x) continuous at a point x? are continuous functions at 
that point (provided that p(x") # 0 in the case of the quotient). 
A constant c can be regarded as the function /(x) = cof x = (xi, ..., Xn). 
It is continuous for any x since 


fGx--M)—f(x)2c-e20-—0 (40) 


A more complicated function is f(x) = x; (j = 1, ..., n) where the index 
j can be equal to one of the numbers |, ..., n. It is also continuous (as 
function of x = (xi, .. ., Xu)!). Indeed, let A = (hı, ..., An); then 


AEA- = atha = My s T0, (5-9) 


A finite number of operations of addition, subtraction and multiplication 
performed on the functions x; and on constants leads to a function called a 
polynomial of x (or a polynomial in the variables x1, . .., Xn). On the basis of 
the above-stated properties we conclude that the polynomials are coritinuous 
functions in R, (for all x € R,). The ratio P/Q of two polynomials is called a 
rational function which is obviously continuous throughout R, except at the 
points x at which Q(x) = 0. 

The function 


P(x) = XM xg xPxy-2xix,— 3x8+4 
is an example of a polynomial of the third degree in the variables x), x» and 


X3. 
There holds the following general theorem. 


Theorem 2. Let f(x, ..., Xm) be a continuous function at a point (x1, . . ., 
x9) in the space R,, and let m < n. 
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If this function is regarded as the function 
F(xi, ..., X) = f(x» ..., Xu) 


of x = (Xn -.., Xn) then the latter function F is continuous (as function of 
x = (Xu ---s Xu) in the space R,) at any point of the form Qd, ..., X9, 
NB aas s, Xp) where the numbers x9 4, ..., X? are arbitrary. 


Indeed, if h = (hi, ..., ^) then 
4,F(x?) = FOx8 hy... x RA) F(X), ..., x8) = 
=f(M+th, tt xp ha)—f G3, RES Xm) -0 (h — 0) 


Let k = (kn ...,k,) be a nonzero vector with nonnegative integral 
components k; (j = 1, ..., n). Such a vector will be briefly spoken of as a 
nonnegative integral vector. Now we shall use the following notation: if 
x = (Xn ...,.%,) ÌS a point of R, then 


x! = ES, XM (2) 


This expression is a continuous function for all x € R, because it is equal 
to the product of a finite number of factors of the form x; each of which is 
a continuous function of x. We also introduce the notation 


kia yk (3) 
jal 
which will be used only for nonnegative integral vectors k and which must 
not be confused with the length |k| = (È 2 of an arbitrary n-dimen- 
sional vector. Let us form the sum Cu 
Pax) = Y, axt = Y a2 aX s XR 


[Aja kjen 


extended over all the possible integral vectors k with |k| =n where a, = 
= dy, ...,,4, are constant coefficients supplied with nonnegative integral 
vector indices &. Such a function P,(x) will be spoken. of as a. polynomial 
in x of degree n. 

Next we state the following theorem. 


Theorem 3. Let a function f(x) = f(%1, ..-, Xm) be continuous at a point 
x" = (xf, ..., X2) belonging to the space R„ (consisting of the points x) 
and let a function q(u) = qy(ui, ...,u,) be continuous at a point u’ = 
= (uf, ..., u9) belonging to the space R, (consisting of the points u). Also 
let pu”) = xf (J = 1, ..., m). Then the (composite) function 


F(u) = f (giu), q»(u), e.. Pniltt)) 


is continuous (with respect to u) at the point u". 
_ Proof. The function f being continuous at x", for any e > 0 there is 
6 > 0 such that f is defined for all x satisfying the condition |x;— x?| < ô 
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(j= 1, ...,m) and such that the inequality | f(x)—/(x*)| < e holds for 
these x's. Further, since the functions p; are continuous at the point a" of 
the space R, there is 7 > 0 such that for the points x € R, belonging to the 
ball |u— u?| = 7 there hold the inequalities 


eu) mm — (j= 1, ..., m) 
Then the inequality 


| F(u)— F(u?)| = Les), AED quu) —f(pu?), e.s yu?) -€ 


also holds, which completes the proof of the theorem. 

A function will be spoken of as an elementary function of the variables 
Xj... XQ if it can be obtained from these variables and from constant 
numbers with the aid of a finite number of operations of addition, subtrac- 
tion, multiplication, division and operations v where p symbolizes element- 
ary functions of one variable (see 8 1.3). The functions 


(i) sin Iny x32? = Ma 
(il) sin? x-- cos 3(x-- y) = f» 
and 


ET X-y X 
(iii) In 5 cu 


can serve as examples of elementary functions of several variables. 

Using Theorems 1-3 we can readily check that the functions p; and q« 
are continuous throughout the xy-plane while the function p3 is obviously 
defined and continuous at the points (x,y) for which the fraction 
(x—y)/(x--y) is finite and positive. 

From Theorem 1 in $ 7.2 and from the definition of the continuity of a 
function at a point follows directly 


Theorem 4. If a function f(x) =f (Xi, ..., Xn) is continuous at a point 
x? and assumes a nonzero value at x it retains sign in a neighbourhood of that 
point which coincides with the sign of f (x). 


Corollary. Let a function f(x) be defined and continuous throughout R, 
(i.e. at all the points of Ra). Then the set G of the points x at which the function 
satisfies the inequality f(x) > ¢ (or f(x) < c) where c is an arbitrary con- 
stant is an open set. 

Indeed, the function F(x) = f(x)—c is continuous on R, and the set of 
all points x where F(x) > 0 coincides with G. Let x? € G; then there is a 
ball 


jx—x°| < ô 
on which F(x) > 0; this means that this ball belongs to G and therefore 


x" c G is an interior point of G. 
The case f(x) < c is treated similarly. 
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Example. Consider the three functions 


O AG) y (a m 0, Gi) fle) = lni 
1 1 


and 
(iii) fa(x) = max Ixl 


They are defined and continuous in the space R,. The continuity of fı 
and f? is obvious and the continuity of f; follows from the following calcula- 
tions: 

a(x + h)—fo(x)| = |max) xe Iii max Exil] = 


= max |x,+h,—x,| = max |A,| — 0 (iA — 0) 
k k 


We see now that the sets of points x for which the inequalities A(x) = c 
(i = 1, 2, 3) hold are open. The first of them is the interior of an ellipsoid in 
the n-dimensional space; in the case n = 2 the second and the third sets 
are the interiors of the squares shown, respectively, in Figs. 7.2 and 7.3. 





Fig. 7.2 Fig. 7.3 


. These three sets are convex since the inequalities f(x) < c and f(y) = c 
imply fi(tx+(1—t)y) < c 0 =t =l. 
The inequalities f(x) > c > 0 specify the exteriors of these figures. 


§ 7.4. Partial Derivatives and Directional Derivative 


In this section we shall consider functions f defined on an arbitrary open 
set G C Rr 
_ By the increment of f at a point x = (xı, ..., Xn) € G with respect to the 
variable x, with step h we shall mean the difference 
Af (x) —f(xi ener Xjijdb x+h, Xj4b -- -> Xn)— S (xy irl Xn) 
where A is a real number which is sufficiently small so that this difference 
makes sense. 


20006-15 
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The partial derivative of f with respect to x; at the point x is defined as the 
limit 
.., n) 


Oxy — Ox neo Rh 





fy = of _ Of(x) zz lim Aga (x) (j= 1, . 


provided that it exists. The partial derivative xis i 


dinary derivative of the function f(xi, ..., Xx) regarded as a function of the 
variable x; alone for fixed xi, ..., xj v, Xj+1s -+ -v Xn 

A function z = f(x, y) of two variables is represented geometrically by 
the locus of points (x, y, f(x, y)) where (x, y) € G, that is by a surface in the 
three-dimensional space in which rectangular Cartesian coordinates (x, y, Z) 
are introduced. It is evident that the derivative f.(xo, yo) (provided it 
exists) is equal to the tangent of the angle of inclination (to the x-axis) of the 
tangent line to the section of that surface by the plane y = yo drawn through 
the point with abscissa Xo. 


is nothing but the or- 





The derivatives =— of (j= 1, ..., n) are also termed the partial derivatives 
of the first order ( n first parit derivatives) ) of f. 
8 9. m 
The expressions Bi Og, j= x, 05 (i,j = 1, ..., n) are called partial 


derivatives of the second order (the second par tial derivatives}. For i = j 
they are denoted as 

0 0 , 0f 

x, Ox," — Ox 

o 0 9 of | 

Theexpressions —— Pu 6x 85^ T dn 0x89 
order (the third partial derivatives) and so on. To denote partial derivatives 
we write 


are partial derivatives of the third 


m ERRE E E E E 
Ox, Ox, ex" Oz Oy Oy Oz Oz Ox «Oz OY Oz? Ox 
m timos 


and the like (also see $ 7.8 (14)). 

As will be shown later, in many important cases these operations of 
successive partial differentiation can be interchanged without affecting the 
ultimate result. 

Another important notion connected with differentiation is the directional 
derivative (it is not used in the case of one independent variable). 

Let w = (01, ..-,@n) be an arbitrary unit vector. The (directional) 
derivative of a function f at a point x in the direction of w (along w) is defined 
as the limit 

D lim f(x 10) — f(x) 
ðw  ,.p t 
t>0 


{provided it exists). It should be stressed that in the computation of this 
limit it is assumed that Z tends to zero retaining positive sign; therefore we 
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is the right-hand derivative of the function f (x 4- cot) 


with respect to t at the point t = 0. 

By analogy with functions of one variable we can speak of the right- 
hand and left-hand partial derivatives with respect to xy. It should also be 
taken into account that the directional derivative along the positive xj-axis 
coincides with the right-hand partial derivative with respect to x, while the 
directional derivative along the negative xj-axis has the sign opposite to that 
of the left-hand derivative with respect to xj. 


can also say that 





of (x) 
aw 


§ 7.5. Differentiable Function. Tangent Plane 


For the sake of simplicity we shall consider the three-dimensional case; 
in the general case of dimension n the argument is quite analogous. The 
case n = 1 was considered separately in $ 5.2. 

Let a function 

u = f(x, V, z) 


be defined in an open set G C Rs and let it possess the continuous partial 
derivatives of the first order = ; a and oF at a point (x, y, z) € G. This 
implies automatically that these: partial: Berivatives also exist in some neigh- 
bourhood of (x, y, z) although they may not be continuous at points different 
from (x, y, z). Let us consider the increment of f at (x, y, z) corresponding 
to an increment (4x, Ay, Az) where | Ax], | Ay, |4z] < ô and ô is sufficiently 
small so that the point (x+ Ax, y-- Ay, z-- Az) does not fall outside the 
indicated neighbourhood. Then there hold the equalities 


Zu = f(x+ Ax, y+Ay, z+ Az) -f(x, y, z) = (1) 
= f(x 4x, y+ Ay, z- Az) -f (x, y+ Ay, z+4z)+ (2) 
TfG, y t Ay, zt Az)—f (x, y, z+ Az)+ (3) 
+f (x, y» z- Az)—f (x, y, z= (4): 
= fz(x- dx, y+ Ay, z- Az) Ax+fy (x, y+ O24y, z-- Az) Ay 
+A (X, Y, z4- 0342) 4z = (5) 
= (fzG y, z) e) dx (Jy (xX, y, z) 3-82) Ay - 
T 65 Y, Z)+ £3) Az = (6) 


= falx, y, z) Ax+fy(%, y, z) Ay +J: (x, y, z) Az--o(0) (e > 0), (7) 
0 < 0, 5, 05 < l, p = y Ax?-+- Ay? 4- Az?, Ei, £5, £3 > 0 (e pé 0) (8) 


(see the explanations below). 

The passage from (2) to the first term in (5) is justified as follows. By the 
hypothesis, the function f(£, y+ Ay, z+ 42) of the variable (considered for 
fixed y+ Ay and z+ Az) has the derivative (with respect to $) on the interval 
[x, x+Ax], and Lagrange's mean-value theorem is applicable to it. The 


15* 
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second and third terms in (5) are explained similarly. The passage from (5) 
to (6) is purely formal; for instance, we simply put 


f(x 01x, yt dy, z+Az) = fix, J: Z)+61 


But the fact that £, — O as p — O is not formal; it is a consequence of the 
assumption that f; is continuous at (x, y, z). Finally, the passage from (6) 
to (7) reduces to the assertion that there holds the relation 


€&1 Ax+ €2 Ay + 63 Az = o(o) (e — 0) 
which is proved (see § 6.2 (8)) as follows: 


je, Ax-+e2 dy+ es Azi/o = o Yet-- e-- e/o = Vet-rezteg +0 (9 + 0) 
We have thus proved the following important theorem. 


Theorem 1. 7f a function u = f(x, y, z) has continuous first-order partial 
derivatives at a point (x, y, z) its increment at this point corresponding to a 
sufficiently small increment (Ax, Ay, Az) is representable in the form 


Mu = of Ax+ $f L Ay+ 2L Az+ olo) (e ~ 0), o = VAx?+ dy?+ Az? (9) 


where the Xi B. ie partial derivatives are taken at the point (x, y, z). 

The values of the partial derivatives on the right-hand side of (9) being 
independent of Ax, Ay, Az, the conditions of Theorem 1 imply that the 
increment of f at (x, y, Z) corresponding to the increment (4x, Ay, 4z) can 
be written in the form 


Au = A Ax+B Ay+C Az+o(¢) (p — 0) (10) 


where the numbers A, B and C are independent of 4x, Ay and 4z. 

Let us state the following definition: if the increment of a function u 
at a point (x, y, z) can be represented as sum (10) for sufficiently small (4x, 
Ay, âz) where A, B and C are constant numbers independent of Ax, Ay 
and Az the function f is said to be differentiable at the point (x, y, z). ` 

Thus, the differentiability of f at (x, y, z) means that the increment Af of 
the function f at this point can be written as the sum of two terms one of which 
is the linear function A Ax-- B Ay+C Az of (Ax, Ay, Az) called the principal 
linear part of the increment Af and the other is an expression dependent on the 
increments Ax, Ay and Az (which can be a complicated function of Ax, Ay, 
Az in the general case) such that when Ax, Ay and Az are made to tend to zero 
it tends to zero faster than o = V Ax?+ Ay? + Az?. 

It is easily seen that if a function f is differentiable at a point (x, y, Z), 
that is if its increment is representable in form (10), it has the derivatives at 
that point equal respectively to A, B and C: 

£z = of _ of _ 
=4 GB aC (11) 

As an instance, let us prove the first relation (11). Suppose that the incre- 

ment of f at (x, y, z) is representable in form (10). Putting dx = h and Ay = 
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= dz = 0 in (10) we obtain the equality 4,,u = Ah+o(h) (h — 0). On 
dividing the latter by h and passing to the limit we arrive at 


. Au of ER 
Ck ur 





From what has been said follows 


Theorem 2. For a function f to be differentiable at a point it is necessary 
that it possess partial derivatives at that point and it is sufficient that it have 
continuous partial derivatives at the point. 

It follows from (10) that a function differentiable at a point is continuous 
at that point. 


Example 1. The function f(x, y, z) equal to zero on the coordinate planes 
x = 0, y = 0 and z = 0 and equal to unity at the other points of R3 obvi- 
ously has zero partial derivatives at the point (0, 0, 0) but is discontinuous 
at that point and therefore cannot be differentiable at it. We see that the 
existence of partial derivatives of a function at a point is not sufficient for 
the differentiability and even for the continuity of the function at that 

oint. 

n We should also stress a distinction between the one-dimensional and 
many-dimensional cases. In the case n = 1 the property of differentiability 
of f at x is expressed in the form of the equality Af = A 4x+ 0(4x) and con- 
sequently if A ~ 0 the second term on the right-hand side tends to zero as 
Ax - O faster than the principal part. But this is no longer the case for 
n > 1; for instance, if n = 3 then for any three numbers A, B and C not 
equal to zero simultaneously we can always make Ax, Ay and 4z tend to 
zero in such a way that the equality A Ax+ B Ay+C Az = 0 constantly holds; 
then the term o(o) in (10) is even greater than the principal linear part. 
By the way, if we make 4x, Ay and Az tend to zero so that the proportion- 
ality relation 4x: dy : Az = A: B: C is fulfilled, the principal part of the 
increment will be exactly of the order of p and the term o(o) will tend to zero 
faster than the principal part. 

If a function f is differentiable at a point (x, y, z) then the principal linear 
part of its increment at that point is also called the differential of f at the 
point (x, y, z) corresponding to the increments Ax, Ay and Az of the inde- 
pendent variables. 'Yhe differential is denoted df — x Axa Ay 2L Az. 

Let us consider a surface S represented by a function z = f(x, y) defined 
in a neighbourhood of a point (xo, yo). 

A plane Lo is termed the tangent plane to the surface S at its point Po = 
= (Xo, Jo, Zo) (zo = f (xo, yo)) if the distance r(P, Lo) from its moving point 
P = (x, y, Z) to Lo tends to zero faster than the distance o from P to Po: 


r(P,Lo) = o(p (e — 0) (12) 


Theorem 3. If a function f is differentiable at a point (Xo, Yo), the surface 
represented by this function has the uniquely determined tangent plane at the 
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point Po(xo, yo, zo) specified by the equation 
z-2= (ar a) (x- xo)+($4), Q'— Yo) (13) 


where ( )o symbolizes the fact that the expression in the parentheses is taken 
for x = xe, y = yo. 

Proof. Let f be a differentiable function at a point (xo, yo), S be the surface 
represented by this function and Lo be the plane described by equation (13). 
The variable point P € S has the coordinates (x, y, f(x, y). As is known 
from analytic geometry, the distance between P and Lo is expressed by the 
formula (see the explanations below) 


(P, Lo) = 32 |f(% S05 Yo)— ($4), e-a- (2), 770 = 


= o(r) = o(o), r-0,0-0 (14) 
where 
o= E eae Lf, y) Gro, JY 
Here M — Vz LS a. -+ 1. The second equality (14) is fulfilled because 


of the Bo ‘that f is differentiable at the point (xo, Jo). As for the last 
equality, it says that the quantity o(r) (r — 0) in (14) possesses the property 
that its ratio to ọ tends to zero as g ~ 0. Indeed, if o — 0 then also r — 0 
(0 <r = o!) and therefore 


20) 
p 


We have proved that the plane specified by equation (13) is the tangent 
plane to S at the point (xo, yo). 

Now we must show that there are no other tangent planes to S at the 
point (xo, yo) distinct from Lo. To this end suppose that there is a tangent 
plane to S at the point Po described by an equation 








- [29.7 


r 9 





=|]. o 
et 


A(x— x0) +B(y— yo)—C(z—20) = 0, A?--B?-C? = | (15) 
Then 
A(x— x0) + BO Yo)—C(f—fr) = o(g) = otn) (16) 


The last equality in (16) is explained as follows. By the differentiability 
of f at the point (xo, yo), we have 


I-A = (25), @— 20+ (S£ who yos 


«Vis Gee o 
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where C is a constant independent of r. Taking into account that « is bounded 
(since « — O for r — 0) we can write 

o = Yr | S-J < Cw 
where C; is independent of r. Consequently, 


1 ov) +  jotg o| | og i 
ime sce ee 
r—0 e-0 
On putting y = vo in (16), dividing by x— xo and passing to the limit as 
X — xo we obtain 


a-c ($£), =0 
Similarly, putting x = xo in (16), dividing by y— yo and passing to the 
limit as y — 1» we receive 
B-C ($L), =0 


We now see that C + 0 because, if otherwise, there would be A = B = 
= C = 0; hence, the plane in question is described by equation (13). 
Example 2. Let us consider the function 
x24 y?) 0-tey* at rational points 
fan = [EM PAD Con 
at irrational points 


where æ = 0. It is obviously discontinuous at every point different from the 
origin; at the origin it is differentiable: 


F(x, y) -/(0, 0) = f(x, y) = Ox+0y+ g'** 


where o!** = o(p) (p — 0). Thus, fis an example of a function differentiable 
at a point but having no continuous partial derivatives at that point. 

Examples 1 and 2 show that the requirement that a function should be 
differentiable at a point is weaker than the requirement that this function 
should have continuous partial derivatives at the point but is stronger than 
the requirement that it should have partial derivatives at the point. 


8 7.6. Derivative of a Composite Function. 
Directional Derivative. Gradient 


We shall limit ourselves to considering functions of three variables defined 
in an open set G C Rj. The extension of the facts established here to the 
n-dimensional case is carried out analogously. 


Theorem 1. Let a function 


u = f(x, y, z) (1) 
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be differentiable at a point (x, y, z) € G and let functions 
x-—9g(0y-wvy() and z-»() (2) 


dependent on the scalar parameter t have derivatives with respect to t. Then 
the derivative with respect to t of the composite function u = F(t) = f (g(t), (t), 
z(t)) (that is the derivative of f along the curve specified by equation (2)) is 
expressed by the formula 


F(t) = ££), 9O, 10) v' (03-55 (9, VO, 20) v) 
+A (PO, VO, x) zD 


or, in the abbreviated form, 


du _ Of dx Of dy | Of dz 
dt Ox dr * dy di ^ Oz dr (3) 


Indeed, by the differentiability of f at (x, y, z), we have 


Zu = f (x Ax, y+ Ay, z+ Az)—f(x, y, 2) = 


Q [S 9. 
= 2 ax Ay 2L Az4- o(p) 


y 
(e = ¥Ax?+ Ay* + Az? — 0) (4) 


for any sufficiently small increment (4x, Ay, Az). Let us give an increment 
At to the value ¢ of the parameter to which, in accordance with equalities 
(2), there corresponds the point (x, y, z). This results in some increments 
Ax, Ay and Az of functions (2). If these very increments are substituted into 
(4) the left member of (4) becomes equal to the increment F(t+ At)— F(t) = 
= Au of the function F at the point 1. On dividing (4) by 4t and passing 
to the limit we obtain 
vA qu Meo oi af Ax , Of dy , Of Az, ofe)\ _ 
F()- lim 4 = lim (Seu Atem x) 
_ of dx , Of dy, Of dz 
~ 6x dt ' dy dr" Oz dr 


which proves (3) because functions (2) possess derivatives and 
AxV jAy , (4 TIERT we 
e-o ESHA) +) - R= 0 -o 


(At — 0 implies o — 0). 


Theorem 2. If a function f is differentiable at a point (x, y, z) its derivative 
in the direction of any unit vector n = (cosa, cos B, cos y) exists and is 
expressed by the formula 

of _ af 


" of of 
an = ax 005 ay COS P+ S cos Y (5) 
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Proof. According to the definition of the directional derivative (see § 7.4) 
and by virtue of the foregoing theorem we have 


ef f(x4t cosa, y+t cos B, zetcosy)-f(x, y, z) _ 
5 a eee eee 


= li 
m t 


1—0 
t>0 


ee y+tcos f, z-- t cos »], = 


= M cos atl L cos B+% f cosy 


where the partial ie: are taken at E y, 2). 
If x = ¢(s), y = v(s), z = 7(s) are equations of a smooth curve /' where 
the parameter s is the arc length then the derivatives 
= E dys, dz _ 
m=?)  qo—vG) and = (s) 
are equal to ie direction cosines of the tangent vector to I’. Therefore the 
expression 


3 9 ' 

$ - Sco G-- Lv GS LG) = A fos G) vO 09) 
where f is a Pape. ‘hasten is the directional derivative of f along 
the indicated tangent vector. In such a case we also say that of is the deriva- 


tive of f along T. 

Let us consider the vector 

(9f 9f of 
grad f= (a. ey’ =.) (6) 

It is called the gradient of the function f at the point (x, y, z). 

The plane passing through a point (xo, yo, zo) perpendicularly to the 
gradient of f at this point, provided that the gradient is different from zero, 
has the equation 


(3), (x— x) (24 2) o- yo (of 1). c- Zo) = 0 (7) 


((p)o = w(xo, Yo. zo)) 
A remarkable property of this plane is that, according to (5), it can be 
interpreted as the locus of rays issued from (xo, yo, zo) along which the 
derivative of fis equal to zero. In § 7.19 we shall prove that this is the tangent 
plane at the point (xo, yo, zo) to the surface specified by the equation 


I(x, y,2) = A (A = f (xo; Yo, Zo)) (8) 


Formula (5) means that the derivative of f in the direction of unit vector 
n at the point (x, y, z) is equal to the projection of the gradient of f at this 
point on that direction: 


= (grad f, n) = grad, f (9) 
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For any vector there holds the obvious inequality 


3 
x = |grad f | (10) 
If grad f = 0 (usually this only occurs at some singular points) then a = 


for any vector n. If grad f = 0, that is if at least one of the partial derivatives 
of f is different from zero, then (10) is a strict inequality for all unit vectors 
n except for the single vector my = (cos xo, cos Bo, cos yo) going in the direc- 
tion of grad f. Thus, 








cos po = AW T8. TU (11) 
V ar) (85) + (ae) 
of 


Oz 
Pues [Of \2 or\? TOf 
V(S (8) +) 
It follows that the gradient of the function f at a point (x, y, z) can be 
defined as a vector possessing the following two properties: 
(i) its length is equal to the maximum possible value of the directional 
derivative oe at (x, y, 2) (this maximum value exists for any function differen- 


tiable at (x, y, z) and is a nonnegative number) ; 
(ii) if its length is different from zero it goes along the vector n in whose 


9 
direction the derivative M. attains the maximum value. 


The new definition of the gradient is completely equivalent to its formal 
definition by formula (6); it shows that grad fis an invariant in the sense that 
it can be defined irrespective of the choice of the coordinate system in which 
the function u dependent on the moving point in the space.is considered 
(see (1)). To elucidate what has been said let us consider a physical example. 
Suppose that G is a part of space occupied by a physical body and u — u(P) 
is the temperature at its variable point P; in the general case the temperature 
varies from point to point. If we introduce rectangular coordinates (x, y, z) 
in space this "physical" function u = u(P) can be replaced by the “mathe- 
matical” function u = f(x, y, z) where (x, y, z) are the coordinates of the 
point P € G. If we take another rectangular system (x', y’, z") the same 
physical function is represented by another mathematical function 


u = fx, y, z’) = 
= flaix tay taaz’, Bix’ + Boy’ +Baz', yax'yay' + yaz’) (12) 
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where 
x = ax! May! +032", y = fax + Boy’ az, z = yax yov traz (13) 


are the transformation formulas from the old coordinates (x, y, z) to the 
new ones (x’, y', 2’), the functions f(x, y, z) and f(x’, y’, x’) being different 
in the general case. 

It is natural to define the gradient of the physical function u = u(P) in 
accordance with the second definition stated above, that is as a vector in 
whose direction the rate of increase of the temperature at the given point P 
is the greatest and whose length is equal to the maximum rate of increase 
of the temperature. 

We know that if the mathematical function f describing the physical 
function in question in the coordinate system (x, y, z) is differentiable at a 
point P — (x, y, z) the gradient of this iu TS at that point makes sense, 
and its three components are ra ; E and 5 , Le. the gradient is 

= of M 


ax? Oy? Or (14) 


In the other coordinate system (x', y', 2’) the same vector is represented by 
another triple of quantities: 
( 9A 0f A ) 


Sh Bh 0^ (15) 


What has been said can be interpreted as a “physical” proof of the fact that 
if fis a differentiable function at a point (x, y, z) then the vector represented 
by the triple of numbers (14) in the original coordinate system (x, y, z) is 
specified in any new coordinate system (x', y', z’) by another triple given by 
formula (15) in which f, is determined by formulas (12), (13). But this 
fact can also be proved formally as a mathematical proposition. 

Indeed, according to the formulas known from analytic geometry, the 
components of vector (14) in the new system (x', y’, 2’) are 


ef , BS oy Of | 9f 


ae F + +71 Oz Ox 
of 0f 16). 
2 eB. z Fb yg 2L gr Oe (16) 
i of oe of 
“By —+ Ba oy Sy 173 Br = J 


Sh ; x and =; eh ; 
follows from Theorem 1 on the differentiation of a composite funelon. 
When applying this theorem one should take into account that the ordinary 
derivative with respect to ¢ can be replaced by the partial derivative with 
respect to /. 

The gradient of fis also written in the form 


grad f= Vf (17). 


The fact that these components are, MM equal to 
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where the symbol V designates the operator which associates the vector 
grad f with every function f differentiable at (x, y, z). This operator is called 
the Hamiltonian operator or nabla or del*. It is convenient to regard it as a 
o 3 


fo] 
Bx? By Ud ge! 


3 [s að 
=(] ow) (18) 
The gradient grad f can then be interpreted as the symbolic product of the 
vector V by the scalar f. 
In the physical interpretation of a function as a quantity u dependent on 
the moving point in space it is natural to rewrite formulas (16) without 
introducing the functional A pipe f and A for different coordinate systems: 


a 
(1-— s Ag d $$ = = 


Ou 
ot + Bo oe ay +y & = = $y (19) 


Qu Ou Ou 
E et? 36; ~ or 


symbolic (formal) vector with components 


In the formal mathematical theory of vectors by a (three-dimensional) 
vector is meant an abstract object denoted by a symbol a which is represented 
in every orthogonal coordinate system (x, y, z) by a triple of numbers 
a = (0,,a,, a;) (which are tbe components of a in the system) on condition 
that the components ax, dy, d; of the vector a in any other orthogonal 
coordinate system (x', y', z') (a = (ay, ay ,a7)) are obtained from (ax, ay, a;) 
by means of the transformation formulas 


ay = Xix + bay +yz Ay = &o0s4- Body +7202, 
dy = &30,-- p34, 4- yd; 


"These formulas are analogous to the transformation formulas from the old 
coordinates (x, y, z) to the new ones (x’, y', 2’): 


x =ayxtfiytyiz, y = axt by +yz,  z! = aax-cBay-ysa 


"Thus, formulas (19) provide a formal proof of the fact that grad f is a vector. 
For further formalization of operations with the symbol V let us consider 
‘the operator V as a symbolic vector having the components (a. g oe = =) 
in the rectangular coordinate system (x, y, z) and the components 
ð a 9|. tal of 
(a $y^ zz) in any other orthogonal system (x’, y’, 2’) and let us agree 
* After W. R. Hamilton (1805-1865), an Irish mathematician. The term nabla intro- 
duced by Hamilton originates from the name (Greek vafj2a) of an ancient musical instru- 
ient of triangular form. 
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that the new components are expressed in terms of the old ones by means 
of the (symbolic) equalities 


AERE: a „ə 
a = a tA yy ta 
0 a a. ð 
or ^ ao zz tP2 Oy 7*3 (20) 


[s] [s] [5] [5] 
s = MG ths ay ts a 


Formulas (20) are written as if the symbolic vector V were a real vector. 
If we multiply (symbolically) the left-hand and right-hand sides of (20) by a 
scalar u (i.e. by a differentiable function u) the resultant relation will coincide 
with equalities (19) expressing the well-known relationship between the 
partial derivatives of the function u. 

Thus, if the components of the gradient of fin a system (x, y, z) are known 
and if it is required to find its, components in another system (x', y’, 2’) 
we can use the following rule: grad f = Vf is interpreted as the product of 
the vector V by the scalar f, the components of V in the system (x', y', 2’) are 
computed by formulas (20) and, finally, these components are multiplied by 
the scalar f. In other words, the transformation of the components of the 
vector Vf to new coordinates is performed as if V werean ordinary vector and 
f were a number (scalar) by which this vector is multiplied. 


Example 1. Let f(r) = F(Q) be a function dependent on the distance 
r = r(P, Q) from a fixed point P = (xo, yo, zo) to the variable point Q = 
= (x, y, z). Then 
— ^ X—Xo Lu vy g z—2Z 
grad F = (fÀ 52, p=, pp) £759) 


is a vector going in the direction of the vector PQ and having the length 
[grad F| —1/'(r)I. M 


ws = |/ (1 cos (PO, n) 


In particular, if F(Q) = f(r) = In (1/r) then 
OF _ cos(PQ, n) 
Ón — r 


Example 2. Let us consider the expressions 








(vu, vi = (S) + (3) * (8) (21) 
and 
du = Vu = atat ien (22) 


They are invariant with respect to the transformations of rectangular coordi- 
nates because Vu = grad u is a vector and thus is an invariant, the left 
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member of (21) is the square of its length (i.e. the scalar product of the 
vector by itself) and VV is a symbolic invariant (i.e. a symbolic scalar equal 
to the product of the symbolic vector V by itself) multiplied by a scalar. 


8 7.7. Independence of Mixed Derivatives 
of the Order of Differentiation 


If f(x, ..., Xy) is a function of n variables x1, ..., x4, its partial deriva- 
tives of higher orders involving differentiation with I pet to different 


oF S T (i = j) and the 


variables, thar is the derivatives of the type 
Ox, ‘Ox, Ox,’ 


like, are termed mixed partial derivatives. 


Theorem 1. Let a function z = f(x, y) be defined in an open set G p is xy- 


plane. If it has the continuous mixed partial derivatives and ata 


9* 
Ox Oy Tre 
point (x, v) belonging to G these derivatives are equal to each other at that 
point: 








ey — ef 
8x ay ^ By Ox (1) 





To prove the theorem we shall use the obvious relation 


Ach Ayn f = Af y +h) f 05 y)] = (x+h, y+) 
—S(x+h, y)- fGs yh) fos y) = Ayn Auf B 


We can also write (see the explanations below) 


Ayn Af = Ayh f (x+h, y)— (x, y = ALG Gerh, y--08)— f; (x, y -08)] = 
= ht fixo Oh, y-0h) = RISE, y)+e] (e+ 0 for h— 0) (3) 


is continuous at the point (x, y) it exists in a 





Oz 
Ox Oy 
sufficiently small neighbourhood of this point and the derivative = gt 
exists automatically in this neighbourhood. If ^ is sufficiently small the 
points we deal with do not fall outside this neighbourhood and therefore it is 
legitimate to apply the mean-value theorem (with respect to y) to the function 
[/(x--h, y)—f(x, y)) as was done in the second equality (3). The third 
equality (3) results from the application of the same theorem to f, (with 
respect to x) which is also legitimate since in the neighbourhood in question 


there exists the partial derivative oe = fey. The last equality in which we 
indicate that € — 0 as h — 0 expresses the continuity of the derivative fz, at 


the point (x, »). It follows from (3) that 


Since the derivative 


. An d 7 
lim etel. = fes, y) 
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Similarly, using the continuity of fj, we readily prove the equality 


š 1, Zl, 
lim Aadal fio, y) 
h => 


Now, since 41, Sonf = Ayn Axnf for any 4, we conclude that (1) holds. 

It should be noted that the requirement that both partial derivatives 
entering into (1) should be continuous is only a sufficient condition for the 
validity of equality (1). Some less restrictive conditions on f which imply (1) 
are also known but they are rarely used and we do not discuss them here. 

Let us take an arbitrary nonnegative integral vector k = (ki, ..., Kn) 
(Kj = 0). We shall say that a partial derivative is associated with the vector 


k if in the computation of the derivative the operation 2 is performed 
: : MEN 
not more than 4; times for any j = 1, ..., n. In particular, if k; = O the 


operation 8 is not performed. Now we state the following theorem. 

Theorem 2. 7f all partial derivatives of a function f(x) = f(xy ..., Xa) 
associated with a given vector k are continuous (in the space R,) at a point x 
then it is allowable to change arbitrarily the order of differentiation in any of 
these derivatives without affecting the ultimate result. 

The proof of this general theorem is rather simple but involves a lengthy 
induction argument and therefore we shall confine ourselves to an example. 
The derivative 9. 

Oz Ox Oz Oy 

Assuming that not only this derivative but also all the other derivatives of 

f associated with the vector (1, 1, 2) are continuous with respect to (x, y, z) 

we can obtain, by using the definition of the partial derivative and Theorem 
1, the equalities 


is obviously associated with the vector (1, 1, 2). 











ey 9 of e& uua o [s 
Oz0x0:0y — Oz0x ðzðy = E ðz/ x Oz \ðy Oz 
0 0 (5-2 a (5- oV 
— Ox dz 8y Voz dx Oy 0z Ox Oy dz* 
For instance, to derive the second equality we argue as follows: by the 
32 
hypothesis, the derivatives = ae and zu are continuous with respect to 


(x, y, z); therefore they are sure to be continuous with respect to (y, z) 
for a fixed x and consequently they are equal to each other. In the fifth 


equality the same argument is applied to of (instead of /). 


Exercise. Prove that the function 
= 1 UT 
v= 8al- 1i: € 
where 


r = (x xo)*- Qr — yo) + (2 zo)? 
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satisfies the partial differential equations 
ec =0 and 4o4 2 =0 
fo 


where 


+242 and J= +5 +S 


do = mt Oy; Oz, 3x? 


(The function v termed the fundamental solution of di heat conductivity 
equation is encountered in mathematical physics.) 


§ 7.8. Differential of a Function. Differentials 


of Higher Orders 
Let us consider a function 
W = f(x) =f(x1, sees Xn) (1) 
defined in an open set G C R,. It can berepresented in infinitely many ways 
in the form 
Ww = gu) = qui, EI Un) (2) 
where 
w= yx) (j= 1,...,m, x€ G) (3) 


We shall use the following terminology: the variable W will be spoken 
of as a function of the independent vector variable x, and the same variable 
W will be referred to as a function of the dependent vector variable u. The 
latter variable (u) depends on the independent variable x; to each vector 
x belonging to G there corresponds the vector u = (y(x), weiss Pm(x)). 

Thus, the vector variable x will play an exceptional role: in all the consider- 
ations below it will only enter as an independent variable. 

Let the function f possess continuous partial derivatives of the first order 
at a point x € G. Then, as is known from§ 7.5, it is differentiable, that i is its 
increment at this point can be represented in the form 


AW = Y adroo (e+ 0) (4) 
where 
a 1/2 
o = |Ax| = (X An) 
j=1 
Thesum 


dW = > a Ax, (5) 


is called the principal linear part of the increment of W at the point x (and 
also the differential of W at that point) corresponding to the increments 
Ax, ...; AX, of the independent variables. 


DIFFERENTIAL CALCULUS. FUNCTIONS OF SEVERAL VARIABLES 241 


For the independent variables x, ..., x, we put 
Ax; = dx; (jo ...,n) (6) 


and call these quantities the differentials of xı, ..., x,. The differentials 
dx; will also be called independent differentials in order to stress that they 
are independent of x = Qa, .. +) Xn). The “independence” of the quantities 
dx; is displayed formally in the differentiation process: when differentiating 
VAST tad sage to Xi, ..., Xa we regard them as constants, i.e. d(dx;) = 0, 

-]...nm. 

By virtue of the convention expressed by (6), the differential of W can be 
written in the form 


dW = pes eL dx, (7) 


It is clear that dW is a quantity which, generally speaking, depends both on 
Xj «+ -3 Xa and on dxy, ..., dx,. 

The general properties expressed by the relations below apply to any two 
functions u and v having continuous partial derivatives at x: 


d(u 3 v) = dux dv (8) 
d(ue) = udv-- v du (9) 
4(£)-*9 7 — (os 0) (10) 


v vt 
In these formulas the partial derivatives of the functions in the parentheses 
are continuous at the point x. 
As an example, let us prove the third of these equalities: 
Ou Ov 


TO "Ox Oxy diee 
ped 


- uj á Z 8 /u "M 
{nð du—u dv 
IEEE s dy) = tae 


The continuity of E (=) is seen from the third term in this chain of 
equalities. i 

The differential of W is also called the differential of the first order (below 
we also consider higher-order differentials). 

Now let us suppose that the function W has continuous partial derivatives 
of the second order. The second differential of W corresponding to the 
independent increments (differentials) dx;, . . ., dx, is defined by the equality 


i PW = d(dW) (11) 


where the operation d used twice in the right-hand side of (11) is performed 
for the given independent increments dx;, ..., dx, which are regarded as 


20006—16 
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constants independent of xi, ..., x,. Thus, 


dW = ay os = Y d (£as) = y (424) dx, = 
"m J7 2 M an 





fd dx; (12) 


oy . m l : : 
Since 4— 8x, Ox, E Ox, , the second differential is a quadratic form in the 


independent differentials dx, ..., dx,. 

Generally, the differential of the /th order (or, simply, the /th differential) 
of W taken for the independent differentials dx,, ..., dx, is defined by 
induction with the aid of the recurrence formula 


aw = d(d'^) (l= 2,3, ...) (13) 


where d!, d and d/^! are taken for the indicated independent differentials 
dx; the latter being regarded as constants (independent of x), ..., Xa) in the 
computation process. 

Arguing as in the deduction of (12) we readily see that 


oy 
PW = Y Y Y Bey 8x Be, C dx dx 


k=l jel j=l 
The expression of the /th differential can be conveniently written in the form 


dW = LW deh, wo = — OF 
teres K! axit... Oar 


k = (kn .. s ko) Ik] = F kj dx = dx LL. dee 
L 


k! = kı! ... ka! (0! = 1) (14) 


where the sum is extended over all t the nonnegative integral vectors k with 
ik] = L Formula (14) is proved by induction. . 

We have defined the notion of the differential of the function W in terms 
of the independent variables x1, ..., x, (or, which is the same, in terms of 
the vector variable x). Now let us suppose that the variable W is regarded as a 
function of the dependent vector variable u = (11, . . ., tim) (see the beginning 
of the section). There artses the question as to what are the expressions of 
the first and higher differentials in terms of the variable u. We begin the 
study of this question with the case of the first differential. 

We shall assume that the functions g(u) and y,(x) (j = 1, . .., 1) mentioned 
at the beginning of the section have continuous partial derivatives of the 
first order. Then 


n n " 
dW = 2 ern = Y sz dx; — à ed Sw q, 
j=l 


; Ou, 8x4 
oe : 


E 


Oy, 
Le EJ » Gy, OG = T > SP du, (15) 


DIFFERENTIAL CALCULUS. FUNCTIONS OF SEVERAL VARIABLES 243 


We thus see that, as in the case of one independent variable, the first 
differential of W is expressed in terms of the dependent variables in the 
same way as in terms of the independent variables. This demonstrates 
the invariance of the form of the first differential. 

To answer the question stated above for the case of the second differential 
we shall suppose that the functions v and sy; possess continuous partial 
derivatives of the second order. 

On differentiating both members of (15) and taking into account proper- 
ties (8) and (9) we obtain (see the explanations below) 


aw = d(dW) = È a ‘ => (Xana sete du dy + Pa) " 


i-1 


E Y È anog "i a du; dut Y y o 99 dtu, (16) 


i-1 J 


In the second equality (16) we have applied property (8) and in the third 
equality we have used property (9) and also the fact that the form of the 
first differential remains unchanged when we pass to the dependent variables 
uj. We see that, in contrast to the first differential, the second differential of 
W expressed in terms of the dependent variables u; is the sum of two sum- 
mands of essentially different nature. The first summand is a quadratic form 
analogous to form (12) expressing d?W in terms of the independent variables. 
As to the second summand, it is an additional expression which is different 
from zero when u; # x; and therefore should be taken into account in the 
general case. 

It should be noted that, as follows from our argument, if expression (16) 
is taken for the differentials dx,, ..., dx, which enter into expression (12) 
then both expressions coincide identically for any point x and any dx; 
provided that the indicated continuous partial derivatives of the second 
order exist at x. 

The expressions of the differentials d'W, d'W, ... in terms of the depen- 
dent variables u; are found in a similar way but they become more and still 
more complicated as the order of the differential increases. © 


$ 7.9. Limit Point. Weierstrass Theorem. 
Closed and Open Sets 


Let us consider an arbitrary set E of points x = (xi, ..., x,) belonging to 
the space R, = R. 

A point x? = (xf, ..., x2) is called a limit point (or accumulation point) 
of E if its every neighbourhood contains at least one point x belonging to 
E and distinct from x*. 

This definition does in fact imply that any neighbourhood of x? contains 
an infinitude of points x belonging to E and that it is possible to choose a 
sequence of points x* € E, k = 1,2,..., such that x^ = x? and | x*— x?| — 0. 


16* 
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Indeed, by the above definition of a limit point, for any natural k = 1, 2,... 
there is a point x* € E for which 0 < |x^—x9?| < 1/k where k = 1,2, .... 

Let us state an alternative definition of a limit point which is obviously 
equivalent to the former. 

A point x? is a limit point of E if any open ball (open cube) with centre at 
x? contains at least one point x € E, x = x" or if there exists a sequence of 
points (x*) such that x* € E, x* » x? and x* — x9 (k + e). 

The set of all limit points of E is denoted by E' and is called the derived 
set of E. 


Example 1. Let E be the set of points x = (xi, ..., X„) with rational 
coordinates. Then any point x? = (x), ..., x9) € R is a limit point of E 
because any cube |x;—x?| < 6 (j = 1, ..., n) contains points of E different 
from x°. Thus, E' = R,. 


Example 2. A finite set x}, x’, ..., xN has no limit points (i.e. E' = 0); 
this follows, for instance, from the fact that any neighbourhood of a limit 
point must contain an infinite number of points belonging to E. 


Example 3. The set E consisting of the points x* = (k, 0, ..., 0) (k = 1, 

, ...) has no limit points (E' = 0) because the distance between its any 
two points satisfies the inequality |x*—x/| = |k—/| = 1 (k # I). If a point 
x € R, were a limit point of E its any sufficiently small neighbourhood 
would contain two points belonging to E, which means that such points 
would lie at a distance less than any arbitrarily small 6 = 0 from each other. 


Example 4. Let V, = E < e} r sfx: y = "i 


1 1 


Extending our usual terminology used in the case = 3 to an arbitrary 
dimension n we shall say that V; is an open ball (sphere) in R, with centre 
at the origin and that 7" is its boundary and V; is its exterior. There hold the 
following relations: 


Vi= Vitt, (Vit Dy = Vi, Vs = Vat, 
Vet ly = bet I, =r (1) 


Visual geometrical considerations (see Fig. 7.4) which can be easily 
expressed in terms of inequalities show that any point x!€ V; can be enclosed 
in a sufficiently small ball with centre at this point contained entirely in V; 
whence it follows that x! is a limit point of V; but is not a limit point either 
of I' or of V». Any ball with centre at an arbitrary point x? € I" contains 
some points belonging to V1, /' and V2 different from x? € I’ and therefore 
x? is a limit point of Vy, I', V», V,--I' and V;4-1*. Finally, an arbitrary 
point x? € V» can be enclosed into a ball entirely contained in V2 and hence 
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it is a limit point of V» butis nota limit 

point of any of the sets Vi, I' and 

Vı+T. We have thus proved equalities 

1). 
: t is said to be bounded if it is 
contained in some ball (cube). If other- 
wise, the set E is said to de unbounded. 
The ball (cube) mentioneb in these 
definitions can be taken with centre 

at the origin because if all the points 
x € Esatisfy the inequality |x—x®| < o; 

they also satisfy the inequality 

|x| «|x—x?]|--]x9] <p> where p= Fig. 7.4 
= p [x?l. 

The following theorem generalizes the corresponding one-dimensional 

theorem and is based on it. 


Theorem 1. Every bounded sequence of points x* — (x5, . . ., x*) (k23, 2, .. .) 
contains a subsequence {x} (l = 1, 2, ...) convergent to a point x9: 


]x*—x|| + 0 (l — œ) 
Proof. The sequence (x^) being bounded, there is a number M such that 
M-dix*ebd| Q-Lh...mk-L2...) 


This shows that the coordinates of the points x^ are also bounded. The first 
coordinates of these points form a bounded sequence (xf) (k = 1, 2, ...), 
and, by virtue of the analogous theorem for the one-dimensional case, there 
is a sequence (k,) of natural numbers and a number x? such that xf > 
— x9 (f, + œ). Now let us consider the second coordinates xf but only 
for the natural k; indicated above. The subsequence [x$^) is bounded and, 
by virtue of the one-dimensional theorem, there is a subsequence {x$} and 
a number x2 such that xk — x9. Since {k} is a subsequence of (k^) we 
simultaneously have xf» x? and xk + x9. Proceeding to argue in 
this way and taking into account the boundedness of the set of the third 
coordinates we obtain a subsequence (k^) of the subsequence (K^) for which, 
simultaneously, 


xo, dheg and xh + 239 


where x2 is a certain number. At the mth stage of this process we arrive at a 
subsequence of natural numbers k; =k; and at a system of numbers xj, . . ., x9 
such that the relations xf — x? (/ 95; j= 1, ..., n) hold simultaneo- 
usly. Finally, putting x?— (x2, ..., x2) we complete the proof of the theorem. 

Let us come back to limit points. A finite set (i.e. a set consisting of a 
finite number of points) has no limit points (Example 2). There are also 
infinite and unbounded sets having no limit points (Example 3). For the 
bounded infinite sets there holds the following theorem. 
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Theorem 2 (Weierstrass). Every bounded infinite set E has at least one limit 
point. 

Proof. Since the set E is infinite it contains an (infinite) sequence {x*} of 
pairwise distinct points. According to the foregoing theorem, there exists a 
subsequence (x^) convergent to a point x? € R, Since the points x^ 
corresponding to different / are distinct the point x? is obviously a limit 
point of E because its any neighbourhood contains some points x^ c E 
different from x? (of course, x? may or may not belong to E). 

A set E C R, is said to be closedif allits limit points belong to it, i.e. if 
E' c E. 

It should be stressed that this definition does not require that E should 
have limit points; it only requires that if E has such points they should 
belong to E. Thus, every set which has no limit points is closed. An empty set, 
a finite set and a set of integral points (that consists of points having integral 
coordinates) in the space R, are all examples of closed sets. 

The set in Example 1 is not closed because the irrational points (i.e. points 
having irrational coordinates) are its limit points but do not belong to it. 

A ball with boundary (Example 4), the exterior of a ball taken together 
with its boundary and the boundary of the ball itself are examples of closed 
sets. An open sphere (ball), the exterior of a closed ball are examples of 
nonclosed sets. This is geometrically evident and can be justified rigorously 
by means of the corresponding inequalities. 

We shall also state an alternative definition of a closed set equvalient to the 
former: a set E is closed if the fact that the points of a sequence {x*} conver- 
gent to x? belong to E implies that x? also belongs to the set E. 

We shall show that these definitions are equivalent. Let E be a closed set 
in the sense of the former definition and let us suppose that the conditions of 
the latter definition of closedness are not fulfilled for E. Then there must 
exist a sequence (x^) and a point x? such that x* € E, x* -- x? and x? ¢ E. 
Obviously, this is only possible when the elements x^ of the sequence run 
over an infinite set of (pairwise distinct) points; therefore x? is a limit point 
of E and, according to the hypothesis, it must belong to E. We have thus 
arrived at a contradiction. Hence, the former definition implies the latter. 

Conversely, let E be a closed set in the sense of the latter definition and let 
x? be a limit point of E; then, as is known, there is a sequence of points 
xk € E such that x* > x?, By the latter definition, we have x? € E and 
consequently every limit point of E belongs to E, which means that E is a 
closed set in the sense of the former definition as well. 

The addition of all limit points of a set E to this set results in a new set 
which is denoted £ and is called the closure of E; hence, E = E+E’. 


Theorem 3. The closure E of a set E is a closed set. 

Proof. Let x? be a limit point of E. Let us take an arbitrary € > 0 and 
consider the ball |x—x?| < e. It must contain a point x’ € E, x’ z x, 
which can be enclosed in a ball lying within the former ball and having a 
sufficiently small radius so that it does not contain the point x?. In the 
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latter ball there must be a point belonging to E which thus belongs to the 
former ball. Consequently, any ball with centre at x? contains a point 
belonging to E and distinct from x°. This means that x° is a limit point of E, 
that is x? € E. 

There is a close relationship between closed and open sets (see § 7.1): 
if E is closed then R—E is open and vice versa. Indeed, let E be closed and 
let x? € R—E; then there is a ball with centre at x° belonging to R—E. 
For, if we suppose that there is no such ball then there must exist a sequence 
of points x* € E convergent to x? (xt — x?) and, by the closedness of E, this 
implies x? € E, which leads to a contradiction. Now let us assume that E 
is an open set. Taking an arbitrary sequence of points x* belonging to R-E 
and convergent to a point x* we conclude that the latter cannot belong to 
E because in its every neighbourhood there are points of R— E; therefore 
x? belongs to R—E, and hence R— E is a closed set. 

Now we state the following three definitions: 

1. A point x? is called a boundary point of the given sct E if its any neigh- 
bourhood contains both points’belonging to E and points not belonging to E. 

2. A point x? is called an interior point of E (see § 7.1) if there is a neigh- 
bourhood of x? entirely contained in the set E. 

3. A point x" is called an exterior point relative to a set E if it does not 
belong to E and if there is a neighbourhood of x? not belonging to F. 

It is obvious that in these definitions "neighbourhood" can be replaced 
by “open ball with centre at x°” or by “open cube with centre at x°”. 

Note that definitions 1-3 are mutually exclusive in the sense that every 
point x € R can only satisfy the conditions of one of these definitions. 

Hence, if we are given an arbitrary set E cC R then, relative to this set, 
the whole space R splits into the following three pairwise disjoint (non- 
intersecting) sets: 

(i) the set E, of all interior points of E called the interior of the set E. 
This is an open set because if x € E; then there is an open sphere (ball) 
with centre at xo lying entirely within E and, since all the points of V are its 
interior points, they are also interior points of E; consequently V € Ei; 

(ii) the set Ez of all exterior points of E called the exterior of E. This is 
'also an open set, which is proved analogously; 

(iii) the set I` of all boundary points of E called the boundary of E. This is a 
closed set because J’ = R— (E+E) and the set E-E» is the sum of the 
two open sets £; and E» and thus is an open set. 

The sets E,--I' and E2+JI are obviously closed since their complements 
(relative to R), i.e. the sets R— (E+) and R- (E»--I)), are open. 

There hold the (set-theoretic) equalities 


EjRD-ELRD-E and E+ I =(R-E)+r = R-E 
whose proof is left to the reader. 
In the equality R = E1+E2+T one or two summands on the right-hand 


side may be an empty set. It should also be noted that an empty set and the 
entire space R are simultaneously open and closed. 
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Example 5. Let a function f(x} be defined and continuous throughout 
Rand let c be a given number; then, as can easily be proved, the sets (f(x) = 
= c), (f(x) = c} and (f(x) =c} (ie. the sets of points x for which the 
corresponding relations written 1n the braces are fulfilled) are closed while 
the sets (f(x) > c) and (/(x) < c) are open. Some of these sets may of 
course be empty; this does not contradict the assertions since an empty set 
is simultaneously open and closed. 

The results of Example 4 follow immediately from these assertions. It 
should also be taken into account that if the function f(x) were only defined 
on a part of R the validity of these assertions might be violated. 


"Theorem 4. Every open ( one-dimensional) set G in the real line is a union 
of a finite or countable number of pairwise disjoint (nonintersecting) open 
intervals: 


G=} ðk (1) 


where 6, are open intervals. 

Indeed, let x? be a point belonging to G; then there exist open intervals 
Ôo = (A, u) covering x? (i.e. containing x°) and lying entirely within the 
set G. Let 


& —inf4 and f = supy 


where the infimum and the supremum are taken over all the possible inter- 
vals à,*. In particular, it may happen that « = — œ or f =+ œ or both 
(in the last case G = (— œ, «»)). To each point x? € G thus corresponds the 
maximum interval 6 = (a, B) which contains x° and is entirely contained 
inG. 

Now let A be the collection of all pairwise distinct intervals of this kind. 
It is clear that the (set-theoretic) sum (that is the union) of all open intervals 
entering into A exactly coincides with the set G. Finally, in each such interval 
we can choose a rational number whence follows that the system of inter- 
vals A is finite or countable since it is equivalent to a subject of the set of 
rational numbers. This completes the proof of the theorem. 


Exercises 


1. Prove that the sum of a finite or countable number of open sets and 
also the intersection of a finite number of open sets is again an open set. 
Give an example of a countable system of open sets whose intersection is 
not an open set. 

2. Prove that the sum of a finite number of closed sets and also the 
intersection of a finite or countable number of closed sets is a closed set. 
Give an example of a countable system of closed sets whose sum is not a 
closed set. 
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§ 7.10. Function on a Set. Properties 
of Continuous Functions on Closed Sets 


Let a function f(x) = f(x1, ..., Xn) be defined on an arbitrary set A in 
the n-dimensional space R, (4 c R=R,) and let x? be a limit point 
of A. We say that a number A is the limit of f at the point x" on the set A 
f lim Pi (x*) = A for any sequence of points x* € A convergent to x9 and 


distinct from x?. 

This definition is equivalent to the following: given any € > 0, there is a 
cube or a sphere (ball) with centre at x? for whose all points x contained in 
A and distinct from x? the inequality | f(x)— 4] < e holds. The equivalence 
of the two definitions is proved by analogy with the case of the limit of a 
function f at a point x? without the stipulation that the function is only 
considered on a given set (see $8 4.1 and 7.2). 

Cauchy's criterion for the existence of the limit of f at a point x? on a set 
A is also proved similarly; in this case it reads: for a (finite) limit of f at 
x9 on A to exist it is necessary and sufficient that, given any £ > 0, there 
should exist ô > O such that the inequality | f (x)—f (x^)| = e is fulfilled for all 
x, x' € A satisfying the conditions 0 < |x—x®| < 6, 0 = [x'—x?| < ô. 

We shall say that a function f defined on a set A is continuous on A at a 


point x? € Aif f 
lim f (x*) = f(x*) (1) 
CA 


for any sequence of points x* € A convergent to x°. 

Note that if x? is an isolated point of A, that is a point which is not a limit 
point of A, then there exists a sphere with centre at x? containing only a 
single point of the set 4, namely the point x? itself. In this case the relations 
xk € A and x* — x? imply that x^ = x? for all k > N where N is subXenEy 
large and hence equality (1) is fulfilled automatically. 

Thus, if x? is an isolated point of A then any function defined on A is con- 
tinuous on A at that point. 

A function f defined on A and continuous at every point of A is said to be 
continuous on the set A. 

We shall prove two theorems expressing some remarkable properties of 
functions continuous on bounded closed sets; they generalize the corre- 
sponding properties of continuous functions of one variable defined on 
closed intervals. 


Theorem 1. A function f continuous on a bounded closed set A is bounded 
on A. 
Proof. Suppose the contrary: let f be unbounded on A; then for any nat- 
ural k thereis a point x* € A such that 
f(x) > k (k= 1,2, ...) (2) 


The sequence (x^) thus obtained is bounded and consequently it contains 
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a subsequence (x*) convergent to a point x? € R,. Since the set A is closed 
the point x0 belongs to it and, by the continuity of fon A at x°, we have 
,uüm jf (x^) = f(x9), which contradicts inequalities (2). 

Theorem 2. A function f continuous on a bounded closed set A attains ity 
maximum and minimum values on that set. 

Proof. By the foregoing theorem, f is bounded on A. Consequeatly the 
function has a finite infimum and a finite supremum on 4: 


m = inf f(x), M = sup /(x) 
xtd XE 


The Properties of the supremum imply that, given any natural &, there is a 
Point x* € 4 such that 
M-t«fG)«sM (k=. (3) 


The sequence {x*} thus obtained is bounded and therefore it contains a 

Subsequence (x^) convergent to some point x?. Since, by the hypothesis, 

the set A is closed it contains the point x?, and the continuity of f on 4 

implies lim f(x) = f(x"). On the other hand, (3) implies that this limit 
4 —. x9 


must be equal to the number M. This means that 
f(x?) = M = max f(x) 
xed 


poe existence of a point y? € A at which f attains its minimus: value on A, 
that is 
S09) = m = min f(x) 
S x4 
!$ proved similarly. : 

Ow let us again consider an arbitraryset A c R(not necessarily bounded 
or closed), and let a function f be defined and bounded on A (it may not be 
continuous). 

For an arbitrary à — 0 we now construct the function 


w(6)= sup [f(x')—f(x”)| (4) 
Jr- <ð 
Y,x'&A 


(a more Precise notation is o (ô, /)) called the modulus of continuity of f on the 
Set A. The supremum on the right-hand side of (4) is taken over the absolute 
values of the differences of the values of J corresponding to all the possible 
Pairs of points x’, x" € A lying at a distance less than ô from one another. 

The modulus of continuity of f(x) is a function of 6 which is obviously 
nonnegative. It is nondecreasing because if 0 < 5 < ô; then 

e(0) — sup |S- a") < 
ix-x'| <a 


Y, EA 


= sup  'f(x)—/(x")| = oô) 
<ð; 
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Consequently there exists the limit 
(0+0) = lim o(0) = A= 0 (5) 
0-0 


0:70 


Theorem 3, Given an arbitrary £ > 0, there is 6 > O such that the inequality 
1f(x) -f(x")] < 24e 


holds for any x', x" € A, |x' —x"| < 6, where 2. is the number defined in (5). 
Proof. Suppose that the assertion of the theorem is not true. Then there 

exists £n > O such that for any natural & there are points xp, x, € A such 

that |xz— xg | < V/A while | f(xj) f (x4 )| 2 A+eo. This implies that 


eX1]E) = | f(xk) — f (xx ) > A+ £o 


for any k and that 4 = (0+0) = lim o(x) = Å+ £o, which is impossible. 
ko 
Let us state the following definition: 
(i) A Function fis said to be uniformly continuous on A if its modulus of 


continuity (4) on A tends tc zero as 6 — O, i.e. 
((0--0) = lim ox) = 0 (6) 
3-0 


We also state an alternative definition of the uniform continuity equivalent 
to the former: 

(ii) A function fis uniformly continuous on A if for any £ > 0 there is 
6 > O such that for any x’, x" € A satisfying the condition [x —x"| <6 
the inequality | f(x’)—/(x")| < e holds. 

By Theorem 3 in which we should put 4 = 0, definition (i) implies (ii). 
Conversely, if (ii) holds then setting an arbitrary « > 0 and taking the num- 
ber ò > 0 mentioned ia (ii) we obtain 


e()- sup |S- «e 
Iw aa 


whence follows (6), that is (i), since w is a monotone nondecreasing function 
of ó. 


Next we state and prove the following important theorem. 


Theorem 4. A function f continuous on a bounded closed set A is uniformly 
continuous on A. 

Proof. Let us suppose the contrary. Then there is £o > O such that for any 
natural k there is a pair of points 


Xe Xe € A4, — xi—xe] < l/k (7) 
if (xn) f(x )] > £o (8) 


By the boundedness of the sequence (x,) and by the closedness of the set A, 
there is a subsequence {x4} convergent to a point x? € A: xj, — x°. Then 


for which 
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(7) implies that xx, also converges to x? and, by the continuity of f at x°, we 


have : ! 
Jim. S-S = -A= 0 


which contradicts (8). 

Let us consider a function f defined on a set A € Rj. We shall suppose that 
it is bounded on A. Let x? € A and ô= 0. Denoting by V, the sphere 
|x—2x?| =ô of radius 6 with centre at x? we put My = Up f(x) and 
m, = inf f(x) It is evident that M, is a nondecreasing function of ô and 

x€4 Vo 
mis a nonincreasing function of 6, and therefore the difference Ms— ms 
is a nondecreasing function of 5. Consequently there exists the limit 


lim (Ma— mo) = w(x?) 
—0 
4-0 


which is called the oscillation of the function f at the point x°. It is easy to 
prove the following theorem. 


Theorem 5. A function f defined on a bounded closed set A is continuous on 
Aat a point x? € A if and only if its oscillation at that point is equal to zero, i.e. 
(w(x°) = 0). 

We shall also prove 


Theorem 6. Let A be a bounded closed set and let 4 > 0. Then the set E; of 
points x € A for which w(x) = 2 is closed. 

Indeed, if x* — x? and w(x*) = A (k = 1,2,...) then x? € A and, besides, 
if Vs(x°) is a ball of radius ô with centre at x° there is k such that the point x* 
lies strictly inside Vs(x°). Therefore there is a ball V.(x*) with centre at x* 
whose radius is so small that 
Vi(xk) c Va(x°) 
and consequently 

Max?) m9) = Mx") mlx") = a(x*) = A 

Hence, Ma&x°)— m(x?) = A for any ball V(x), which implies w(x”) = 2. 


Example 1. Aset Q is said to be convex if the line segment connecting any 
two points of 2 entirely belongs to Q2. 
For a convex set 2 we have the inequality 


(61+ 05, f) ind c(61, f) 4- oX(05, f) (9) 
Indeed, if x’, x" € Q, |x' - x"| « 614-02 then the line segment joining x' 
and x" contains a point x such that |x/—x| < 6, and [x —x| < de. There- 
fore 


o(ói-FÓs, f) = — sup — |f(x^)—f(x^)| = TU I=) -A+ 


[x —x"| 2d, 402 


+ SP, PENSO o +062 /) 
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where the supremums in the third expression are taken over arbitrary x,. 
x’, x" € Q satisfying the corresponding inequalities. 
From (9) follows the inequality 


om) = mo(6) (10) 

valid for any natural m. 
Example 2. From (9) and from the monotonicity of w follow the inequalities. 
0 x (de, f) — lå f) = w(ôz— ôr, f), 0x ôi E ô» (1 1) 


whence we see that w(t, f) is a continuous function of £ = 0 (if f is continuous. 
on the closure of a bounded convex domain Q). 


Example 3. The Dirichlet function which is defined on (0, 1] and is equal to. 
zero at all rational points and equal to unity at the irrational points is dis- 
continuous (relative to [0, 1]) at all the points of the closed interval [0, 1]. 
But at the same time if it is considered as a function defined on the set 4 of 
rational points it is continuous (relative to A) throughout the set A. 

Exercises 


1. Prove that the moduli of continuity c7) of the functions 
(i) Vx (0 <x = 1) (see the beginning of § 15.5); (ii) x? (0 =x = 1); 
(ii) sin x (0 = x = 2) ; (iv) sin + (0 < |x] = 1); 
(v) sin x (— & < x < e) 
are respectively 
. _fve | (Quit) ,. |.fi-üd-5  (0-cran. 
a= | 1 aey MPO], (= £; 


us _ [sin ¢ (0 = t = 7/2), ,. d M. 
(iii) oy - | " (n/2 « t); (iv) w(t) = 2 (0 = 2); 
(yy 00) = l sin + (0 =t =r), 

2 


(x = t). 


2. Show that if w(t) (1 = 0) is a continuous function at the point ¢ = 0 
and satisfies the conditions 


0 = w(52)—@(8;) = w(b2— 01) (0 < 6; < à) 


then it is the modulus of continuity of itself. 
3. By the distance from a point x? € R to a set E C Ris meant the number 


r(x?, E) = inf |x?*—x| = inf Xe 
reE IEE 1 


Here and below E, E;, E; and F are nonempty sets. 
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Prove that if E is a closed set (bounded or unbounded) then there is a point 
Jy € E such that the distance r(x?, E) from x? to E is equal to the distance 
between x? and y: r(x®, E) = min |x?—x| = |x?—y i. 
XEE 


4. Prove that the distance r(x®, E) is a continuous function of x°. 
5. By the distance between two sets Ey and E» is meant the number 


r(Ej E?) = inf |x'—x"| 
ve 
x" CEs 
Prove that if £, and E» are closed sets one of which (or both) is bounded 


then there are two points y € E, and z€ E» such that r(Ej E») = 


= min ix'—x"| = |y—z|, i.e. the above infimum is equal to the 
xX E Ep x” SE, 


distance between these points. It follows from this property that if the sets 
E, and Es arc disjoint (i.e. nonintersecting) then r(£1, Es) > 0 

6. Prove that if F is a closed set, 2 is a bounded open set and F c 2 then 
there is £ > O such that the set F? of points x whose distances to F do not 
exceed « belongs to 2. 


§ 7.11. Extension of a Uniformly Continuous Function. 
Partial Derivatives on the Boundary 
of the Domain of Definition 


Theorem 1. If a function f is uniformly continuous on a nonclosed set A it can 
be extended to A— A in a unique way so that the resultant ( extended) func- 
tion defined on A is continuous on A. 

Proof. Let x? € A—A; then x? is a limit point of A, By the uniform con- 
tinuity of f on A, given any & > 0, there is 6 > O such that 


E-S) e e (1) 
for all x’, x" = A satisfying the condition 
|x'—x"| <ò (2) 


For the points x’, x” € A satisfying the conditions |x' — x?| < 6/2 and | x''— 
—x°| < 6/2 there holds inequality (2) and therefore inequality (1) as well. 
Consequently, by Cauchy’s criterion, the limit of f on A at the point x? exists. 
It appears natural to denote it /(x°), that is to extend f to the point x" by 
defining its value at x? as being equal to this limit. 

Now, let xg and xg’ be two arbitrary points of A such that 


lxo xo | < ô (3) 
Then there are two sequences of points xp, x, € A such that |x— xg | < 6 
and x, — xo, Xg — xo (k — eo). For these points the inequality |f(x,)— 
—f(x;)| < £ holds with any k; on passing to the limit in this inequality as 
k -- co we obtain the relation 


Lf (x0) — (xo) = € (4) 
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Hence, we have proved that, given any e > O, there is 6 > O such that 
the relations xo, x9 € A together with inequality (3) imply automatically 
inequality (4). In other words, we have shown that the extended function fis 
uniformly continuous on A whence it follows that it is continuous at every 
point belonging to the set A. 

There can be no other extension of f satisfying the conditions of the the- 
orem because if we put f to be equal at a point x* € A — A to a number 
different from the limit lim f(x) the extended function f will be discon- 


=x 
tinuous at that point. The theorem has been proved., 


Remark 1. In §4.6 we proved a special case of this theorem when we 
extended the exponential function a* defined originally for rational x to 
irrational x. In this construction we first defined a* on the set of rational x 
and showed that this function was continuous on the set of all rational x 
belonging to any closed interval [c, d]. The closure of this set coincides with 
the entire closed interval [c, d] and therefore a* is continuously extended in 
a unique manner to [c, d]. 

Let Gc R be an open set, G be its closure and f be a function defined and 
continuous on G. It may happen that for some points of the boundary I 
of the set G it is impossible to speak of partial derivatives of f with respect 
to some of its arguments. For instance, if G is the circle o specified by the 
inequality x? y? -« 1 then the derivative f, of a function f(x, y) defined 
on @ does not make sense at the point A = (0, 1) of the boundary of the 
circle because the points of the x-axis adjoining A and lying to the right of A 
do not belong to 2. In such cases it is sometimes possible to define the gene- 
ralized notion of a partial derivative of f with the aid of continuous exten- 
sion. If the given function f is not only continuous on G but also has on G 


the partial derivatives = (j= 1, ...,n) uniformly continuous on G we can 


apply Theorem 1 to extend them continuously to the boundary l = G— G of 
the set G. Such extensions are usually called the corresponding partial deri- 
vatives of f on I although in this case the notion of a partial derivative is 
understood in the generalized sense. Further, if a point x? € T' admits of the 
computation of an ordinary one-sided (i.e. right-hand or left-hand or both) 
derivative the latter coincides with the generalized derivative at that point. 
To show this let us come back to the example of a function defined in the 
erue c. For the point B = (x9, y?), xo > 0, y^] < 1, of the boundary of o we 
ave 


Jo?) fo? Y) — eoe Oh, y) = 04,9), hO ho 0 


where the limit on the right is the corresponding generalized derivative. It is 
evident that in this case there exists the ordinary left-hand derivative of f 
with respect to x at the point (x°, y?) equal to the generalized derivative. 
Later (see § 19.8, Theorems 1, 3 and 4) we shall prove that if the (n— 1)- 
dimensional boundary I’ of a domain G (or a part y of the boundary) is r+1 
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times continuously differentiable then a function f uniformly continuous on 
G together with its partial derivatives up to the order r+1 inclusive can be 
extended across I’ (or across y) with the retention of its differentiability 
properties. In particular, the extended function f(x) will have ordinary 
continuous partial derivatives up to order r inclusive at all the points of 7' 
(or y). 


8 7.12. Nested Rectangle Theorem 
and Heine-Borel* Lemma 


Lemma. Let 
de = {of <3 < BP, -luun k=l.) 


be a nested family of closed rectangles (4, 4,3) with diameters d, = 
= is Y; (bf — a)? tending to zero (d + 0). Then there existsa single point 


1 
x? = (xX, ..., x9) € R belonging to all A, simultaneously. 


Proof. The conditions of the lemma imply that the closed intervals (a, b/9] 
(k = 1, 2,... ) form a nested family for every j = 1,..., n and that their 
lengths tend to zero as k — œ. Therefore, by the nested interval axiom, for 
every j there is a single number x? belonging to all the intervals [a, 59] 
(k = 1, 2,...) simultaneously. Now we see that the point x? with these 
numbers as its coordinates is nothing but the point whose existence is as- 
serted in the lemma. 


Heine-Borel Lemma. Let an infinite system of open sets V (for instance, 
open cubes or balls) cover a bounded closed set E C R (i.e. the union of these 
intervals contains E). Then this system contains a finite subsystem of sets V 
which also covers E. 

Proof. The set E being bounded, there exists a cube 4c R containing E. 
Suppose that the assertion of the lemma fails to hold. Let us divide 4 into 2" 
equal subcubes. Among these smaller cubes there must be at least one (denote 
it by 4,)such that the assertion of the lemma fails to hold for the set E 4, 
(the intersection of E and 41); this means that any finite subsystem of sets V 
does not cover E 4, either. Next we divide 4; into 2” equal cubes; among 
them there is at least one (denote it 42) such that the assertion of the lemma 
does not hold for the set E /1». Continuing this process indefinitely we arrive 
at a nested family of cubes 4; > 42 > ... whose diameters tend to zero such 
that each of the sets E A, (kK = 1, 2,...) cannot be covered by any finite 
system of sets V. The foregoing lemma indicates that there is a point x? C R 
belonging to all A, simultaneously. By the closedness of E, it must belong to 
E as well and therefore it is contained in some set Vo belonging to the system 
in question. Since Vo is an open set we have 4, C Vo for some sufficiently 
large k. Consequently E 4, cC Vo. 


* E, Heine (1821-1881), a German mathematician, F. É. É. Borel (1871-1936), a 
French mathematician. 
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We have thus arrived at a contradiction because, on the one hand, E 4, 
belongs to the set Vo and, on the other hand, there is no finite system of sets 
V covering E Ay. 


8 7.13. Taylor's Formula 


Let us consider a function f(x) = f(x1,. .., x,) defined on an open set Qc 
c R, and having on 2 the continuous partial derivatives needed for the for- 
mulas below to make sense. 

Let us fix a point x9 = (af, ..., X») C O and choose a sufficiently small 
number ô > 0 so that all the points x = (x, . . ., x,) lying within the neigh- 
bourhood 


x—x| = y Xe zd (1) 


of the point x? Y to Q. 
Now we construct the auxiliary function 
F(r) = f(x? 1(x—x*)) = SOPHO o MIE) 


of the variable £ € [0, 1]. We have temporarily fixed one more point x 
belonging to neighbourhood (1). But later x will be regarded as a variable 
point. It is evident that 


F(0) = /(x*) and F(1) = f(x) Q) 


According to the differentiation theorem for a composite function, we 
have 


FO = y (5-39) se ere) (3) 
Jj 
Hence 
F() = Y G- 3) 09 (4) 
f=l ; 


Further, we have 


F'"(t) = y (x; — x?) x (xx— x) BEI (x9 + (x + x9)) = 





j=1 
=È So DaDa He) O 
j=l k21 
and 
F” (0) = Y 5 Qj xJ) Gu X) Eso x?) (6) 
Jz1 k=1 


Arguing by induction we arrive at the derivative 


FO) = y A es y (xj, — Xf) oe (x: pere x?)) (7) 


Ox, ... OXF 
j=l Ji71 


20006 —17 
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and to its value at the point £ = 0: 


FOO) =F... Y Ona). Gu xD OO Ts 


h= — 424 + OX, 


Let f possess partial derivatives up to the order / inclusive on the set 2. 
Then f has continuous ordinary derivatives with respect to £ up to the same 
order / inclusive. Therefore we can write the expasion of the function F(#) 
of one variable by Taylor's formula: 


f-1 ( 
FQ) = X 4; FQ) ri) 
dl 


where r(A) = (H/M) F(? (0t) (0 <0 < 1) and 0 is dependent on x and /. It 


follows that 
1—1 


FU) = Y g FOR, Rix) = rl) = ZF) (9 
0 
Consequently 
f-1 1 a n et (x? 
f(x) = 2 kt = tes X (nR) Q3, XD geo Ri) 
k=0 A-1 JeFl 
(10) 
where 
+ OY (2° + A x— x? 
Rx) = a S (x,— x) t. (x,— -ap See m) (11) 


band hal 


Relations (10), (11) present Taylor's formula for the function f(x) of n 
variables at the point x? with the remainder R, in Lagrange's form. 

It should be noted that among the terms of the multiple sum in (10) there 
are some. coincident with each other. Let us write down several terms of 
Taylor's formula for the case of two independent variables: 


Fx, x2) = fed, x?) BA. (xı— uz a), Ga- x) + 
LE, es re (52), aD aD 
(S) eux] o a le E+ 
+(x2— x2) Eh ft Ri, 


1 0 [A 
Ri=7 (1-39) g 0739 i), f (0 — 0 <1) 
Here we have used the symbolic relation 


(etr) = X clit (eres) 
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The symbols ( )o and ( )ẹ show that in the expressions in the paren- 
theses x is replaced in f by x? and x°+ 0(x— x9} respectively. 
Similarly, in the case of three independent variables we have 


. i , l-1 1 [s] ð 
Fi xe x3) = Y ug [239 s+) + 


k=0 


a qk 
+(x3—x$) ax ]/* Ri, 
] ð ov 
R= 7 [639 a+ es 05739) a], /. 00-1 


'The notation used here should be clear to the reader. 
Taylor's formula can also be written in the following compact form: 


fo- y ER SAOR 
TIPTE 


R= y SPF port oe—x), ^ (0 < 0 <1) 
I qut 


where Ik = Xk, kim... ka! (0-0 f(x) = eR EC 


(x= x) = Ga 7398 ... Qu 7x. 


Taylor's formula is used particularly often in the cases / = 1, 2. If /= 1 
then, on transposing f(x?) to the left-hand side, we obtain the formula 


f()-fG5) = = (Z 


JC 
COSMAS x) 02) 


which generalizes Lagrange’s one-dimensional formula of finite increments 
to the case of dimension n. 
For / = 2 this formula is written as 


I(x) = f(9)+ b (85), + Re 


n 1 n n ay 
R: = m p a Ox, ) nus S C — 3h) 0-3) = 
LA A( B à 
EJ 2. à (orem) Gr xk) Gu xP) eg (13) 


n 
where e — 0 for g? = Y (xj—x7)? — 0. 
j=l 
17* 
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Indeed, by the continuity of the derivatives we deal with, 


(Sete) E (s), t Ex: 


where £,,-- 0 as o + 0, and therefore, putting 7 = max | ei, we conclude 
k, 
that the second summand on the right-hand side of (13) does not exceed 
ny, Y M xke lxt] = "(Y bonc ly = qno? 
k 1 k 


in its absolute value. Therefore this summand can also be written in the 
form so? where |e] < un — 0 (o — 0). 

The last sum in (13) can be rewritten as A(£) — Y » ajj£y5, where 

k=l I=1 
3? x 

Aki = An = (ae), and ëp = (xy— 3$) (k = 1, ..., n). 

Hence, A(£) is a quadratic form in n variables. If we denote & = x- x} = 
= dx, then 





AE) = dih = Y. Y (a5) dus ds 


Ox, On; 


which is nothing but the second differential of fat the point x? corresponding 
to the independent differentials dx,,..., dx. 

We also note that remainder (9) in Taylor's formula for the function F(4) 
of one variable can be written in the integral form (see § 9.17): 


t 
r(t) = dew f (t — uy^1 FO(u) du 
0 


By virtue of (7), to this expression corresponds the following formula for 
the remainder in Taylor's formula for the function f(x) of several vari- 
ables: 


1 
Ri) = n1) = aay J (wrt y x G5, — x9) 
hetl a= 


aisles x9) 
3 (x, — xj) pues du = 


=] 2 (x- aa 2 [a- uy 1 f (x9 + u(x— x°)) du (14) 


By the continuity (with respect to (u, x)) of the integrands in (14) the 
integrals themselves are continuous functions of the parameter x (see § 13.14, 
Theorem 1). Moreover, if the function f has continuous partial derivatives of 
the (/+-s)th order in a neighbourhood of x? the integrals can be differen- 
tiated s times under the integral sign (see § 13.14, Theorem 3). 
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§ 7.14. Taylor’s Formula with Peano’s Form 
of the Remainder. Uniqueness 
of Taylor’s Coefficients 


Let a function /(x)= f(xi, ..., x,) be defined in a neighbourhood Q c R, 
ofa point x? = (xj,. . ., x8) and let, for all x belonging to the sphere | x — x° | < 
< 6 lying within 2, this function be representable in the form 


f(x) = Py(x) + o(oN) (e = [> (x; d = 0) (1) 
Is 


where 
PAx)= Y ay (x— x? 
Ik] en 


n n (2) 
(^ = dkp sid E] = Y kj, (xy = [[ 6-35») 
1 j=l 


In this case we say that the function fis expanded by Taylor’s formula with 
the remainder in Peano's form at the point x". If, for instance, it is known 
that the function f has continuous partial derivatives up to order N inclusive 
in a neighbourhood of the point x! it is representable by formula (1). 

Let us prove that the representation of the function f(x) by formula (1) 
is unique; in other words, we shall show that if f admits of representation (1) 
and, simultaneously, of a representation 


f@)= Y ay(x—x°)*+0(@%) (e~ 0), |x —x"i « à) (3) 
'kiasN 
where aj = dj, ..., ka are constant coefficients then a, = a; (J&|] = N). 
Indeed, on subtracting (3) from (1) we obtain the identity 
02 Y s(x—x9Y-o(oN) (o — 0, e —(a—ax)) (4) 
k SN 


which holds for |x—.x®| < ô. Let us fix the point x and consider the variable 
point z, = x*4- f(x — x?) dependent on £ € [0, 1]. It is obvious that z,—x° = 
= f(x— x?) and |z, — x^| = r[x— x?|. Therefore the substitution of z, for x 
into (4) results in 


02 Y w(x—x9y itl +o) (r^ 0) 
iki mw 


The relation obtained can be written in the form 


0z y Ü Y ey (x — x°)* + o(tN) (t + 0) 


I0 jkj=it 
It follows (see the lemma in $ 5.9) that 
y ax- = 0 ([2 0,1, ..., N) (5) 


ikļ=l 
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for any point x belonging to the ball [x—x?| < 6. Hence, equality (5) is 
fulfilled identically for all x belonging to that ball. On finding the derivative 
of order k = (kı, . . -, k,)of the left-hand side of (5) and substituting x = 
into it we obtain k! - x, = O(|K| = N) whence x = 0, which is what we set 
out to prove. 


Example. For x, y — 0 we have 


1 9 3 2, a 
p(x, y) = ü-3ü-» = [1 Tx toL) [1 TJ) T -o(y3] = 


L+(xty)t+Q?+xy+y’)t o(?) +x2y + xy? + xty? + oly") = 
= l+ (x+y) (x+ xy +y) + ole) (2—0) 


and thus the function y has been expanded at the point (0, 0) by Taylor's 
formula with the remainder o(o?) (p — 0) in Peano's form. 


8 7.15. Local Extremum of a Function 


Let a function f(x) = f(x1, ..., x.) be defined in an open set O c R,- 

We say that f attains its local (unconditional) maximum at a point x? € Q 
if there is a positive number ô > 0 such that the function f(x) is defined for 
all the points x satisfying the condition 


ix—x"| = y (xj x9 < 6 (1) 
JA 


and the inequality f(x) = f(x") is fulfilled for these x. Similarly, we say 
that f attains at x? its local (unconditional) minimum if there is a neighbour- 
hood of type (1) in which the function f is defined and satisfies the inequality 
f) = f (x°). 


Local maxima and minima are referred to as local extrema. 
If a function f attains at a pen x" a local extremum and has the partial 


derivatives of the first. order © of = j= 1,..., n) at that point these deriva- 
tives must vanish at the in xo: 


($5) = SEO sao (j= 1,...,4) 


Ox,/9 
Indeed, in this case the function f(x, .. , 3j- " id Mar ...,A0) of one 
variable x, has a local extremum at x for each j= , nand its derivative 


with respect to x; at the point x; = xj, which is eu to (25). » must turn 
vj 


into zero. 

It follows that to determine the points x? € O where fattains its local ex- 
trema we must seek them among the points x € 2 such that f either has no 
partial derivative at x with respect to some of the variables or has the deriva- 
tives at x equal to zero. We shall be interested in the latter case. Let us show 
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how it can be found whether f has an extremum and what this extremum is 
(i.e. a maximum or a minimum) at a point x? of this kind. 

Let f possess continuous partial derivatives of the second order in a neigh- 
bourhood |x— x?| < à of the point x" in question and let its all partial de- 
rivatives of the first order vanish at x°. Then the expansion of f by Taylor's 
formula (with / — 2) can be written as 


f(a)-f(x") = 3, Y aussi eot (2) 
A=1 [-1 
agp = aK = Cos) —Xx—xX&e—0 foro- ya -0 
h 1 


n n 
The quadratic form A(Ẹ) = $, }, a, 2,5, necessarily possesses one of 
k=1 J=1 
the following properties : 

(i) the form A(£) is positive definite, that is A(Ẹ) = 0 for any ë = 
— (£y, a, ones Èn) with o> 0; 

(ii) the form A(&) is negative definite, that is A(€) < 0 for any € with o = 
> U; 
(iii) the form A(&) is positive semidefinite or negative semidefinite, that 
is A(E) = 0 for all Ẹ or A(Ẹ) = 0 for all £, respectively, and there exists a 


point & = (E, ..., £;) with 9’ y3s > 0 such that A(&£^) = 0; 


1 

(iv) the form A(&) is indefinite, thatis there exist &’ and &” such that 
A(&’) > 0 and A(£") < 0. 

We shall prove that in the first case the function f attains at x? its local 
minimum, in the second case its local maximum, in the fourth case the function 
f is sure to have no extremum and in the third case the question as to whether 
f has an extremum at x? remains open since there are examples in which, under 
the conditions in question, a. function has an extremum at x? or has no.extre- 
mum. 

Taking an arbitrary € with p > 0 we put 7 = &/o — (9... 7»), i.e. 
n = jle (j= 1, ..., n). Then equality (2) can be written as 


f()—f(*) = e'(6() e) (3) 
where | (y) = Y y ay. and 
k=l lel 
j=1 jel 


This means that the function dr) is considered on the spherical surface 
(described by equation (4)) which is a bounded closed point set (denote it by 
a). The function (7) is obviously continuous on c. 
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In Case (i) we have Ø(n) > 0 on ø. Since the set o is bounded and 
closed and the function ®(7) is continuous on it there exists the minimum 
value (n) = m > 0,7 € c. 

Further, since € — O as o — 0 there is a sufficiently small 6 => O such that 
| 5| = m/2 for all ọ = ô. On the basis of (3), we have 


IŒ- > e(m- 2) = Te >0 


for the indicated o, that is the function f attains a local minimum at the 
point x°. 

Assertion (ii) is proved similarly. If the quadratic form in question is 
negative definite we have (n) < 0 for c, and consequently the function 
(n) attains its (negative) maximum on c which we denote — M (M > 0). 
Now, if o < ô for a sufficiently small ô > O then |e] < M/2 and therefore we 
have 


Sœ- < e(-M4 T) -- eo 


for |x— x?| < 6, which means that f has a local maximum at x?. 

In Case (iii) the form turns into zero at some point &’ = 0 and there- 
fore, by the homogeneity of the form, it must also vanish for any point of 
the form x’ = «£' where æ is an arbitrary number. This shows that the form 
is equal to zero for all the indicated points x’ and consequently f(x") — f(x?) = 
= gg. 

But the sign of e is unknown in this case, and therefore it is impossible to 
judge upon the existence of the extremum of fat x? by the second derivatives 
of f. The only conclusion that can be drawn in these circumstances is that 
if the form is not identically equal to zero and is positive semidefinite then 
there can be no maximum at x° and if it is not identically equal to zero and is 
negative semidefinite then there can be no minimum at x°. 

In Case (iv) it is convenient to return to equality (3). By the hypo- 
thesis, in this case there isa point £' at which the form is positive and a point 
E” at which it is negative; therefore at the points 7/ and n” corresponding to 
them we have the inequalities (z/) > 0 and (n) = 0, and for small o we 
have ©(n')-+ z > Oand (n) +e< 0. This means that in any neighbourhood 
of x°, however small, there are points x’ and x" such that f(x") > f(x?) and 

f(x") < f(x*), that is there is no extremum of f at x°. 

Let us consider the sequence of the so-called principal ( diagonal ) minors 
of the quadratic form A(£): 


au az. . A= di... Ani 
les n — 


A, = 43; 42 = 








d» de» H Onl .+- Ann 


By the Sylvester theorem proved in the theory of quadratic forms, we can 
assert that 

(i) if 4, > 0, 42 — 0, ...,4, > 0 then the form is positive definite (Case 1); 

Gi) if 4; <0, 42 > 0, 43 < 0, ..., (—1)"4, > 0, the form is negative 
definite (Case 2); 
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(iii) if 4) = 0, dy = 0, $e 4, z- 0 or Zl <Q, da = 0, gia (—-1y 4A, 2520 
and if there is j for which 4, = 0 then the form is positive or negative semi- 
definite respectively (Case 3); 

(iv) in all the other cases the form is indefinite (Case 4). 

In the two-dimensional case cquality (2) takes the form 


FQ, X-A, A) = 7 (A+ 2BE i CH) e ee, 


A= EaR Be (aeons = (h 


and the corresponding sequence of principal minors consists of only two 
terms: 


Z- A, 4 «|^ B| Z AC- p: 
|B C 


Consequently, 

(a) if A > 0 and AC — B? > O then f has a minimum at x°; 

(b) if A < 0 and AC— B? => 0 then there is a maximum of fat x*; 

(c) if AC — B? < 0 there is no extremum at x?; 

(d) if AC— B? = 0 then it is impossible to judge upon the existence of an 
extremum at x? by the second derivatives of fat x". 

These assertions can also be easily deduced from the representation 


AC) = AE 2BEg +C? = AEF PI Y AC Py 


where A 4 0 (£ = (& n) # 0). 

In Case (a) we have AÇ) > 0 if || > 0, and if 7 = 0 then there must be 
£ = 0 which again implies A(Z) > 0. 

In Case (b) we have A(Z) < 0 if |n| > 0, and ifņ = Othen 5 ~ Oand again 
wA(f) < 0. 

In Case (c) with A # Oitis possible to find (5, n) such thaty = O and (A + 
+ Bn) = O and, on the other hand, to put 7 = O and £ > 0. In both cases we 
obtain A(C) = 0 but the signs of the quadratic form are different. If A = 0 
but C = 0 the same conclusions can be drawn if the roles of A and C are 
interchanged. 

In Case (d) we have A(£) = (Aé+Bn)?/A for A = 0, and there is a point 
¢ = (E, n) not coinciding with the origin such that A(Z) = 0. The same is ob- 
tained when C + 0 if we replace A by C in the argument. Finally, if A = 
= C = Othe form A(C) = B£y is obviously indefinite. 


Example 1. For the function f(x, y) = %+y—9xy+1 the equations 
9f 
ex 
and x — y — O (the case when there are no extrema). 


= 0, E: = 0 have two solutions: x = y = 3 (the case of a minimum) 


Example 2. For the function f(x, y) = x'-F y1i—23?-cAxy — 2*4] the 
corresponding equations have three solutions: x — +72, y-2-y2; x= 


266 A COURSE OF MATHEMATICAL ANALYSIS 


=—Y2, y 2 4-Y2 and x = y = 0. Accordingly, the first solution corre- 
sponds to a minimum, the second solution also corresponds to a minimum 
and in the case of the third solution there is no extremum. 


Example 3. Equating to zero the derivatives of the function f(x, y) = x?— 
— 2xy*4- y!— y? we find x = y = 0 (an ambiguous case). On the other hand, 
we obviously have f(x, y) = (x—y?Y— y5, and, since f(e?, €) =—& <0 
and f(e, 0) = e? > 0 for any £ > O, there is no extremum at the point (0, 0). 
At the same time the function y(7) = f(At, kt) has a minimum for t = 0 for 
any h and k such that /?-- k? > 0. 


8 7.16. Existence Theorem for an Implicit Function 


Let us take an arbitrary function f(x, y) of two variables v and y and 
equate it to zero: 
fix, y) = 0 (1) 


Let WM denote the set of all the points (x, y) for which equality (1) is ful- 
filled and let (xo, yo) be a point belonging to this set, that is /'(xo, yo) = 0. 

If no additional conditions are imposed on the function f the set Yt can 
be of an arbitrary structure. For example, in the case of the function /(x, y)— 
= (x— xo)*-- (y— yo)? the set M consists of a single point (xo, yo); if 


JG, y) = Gc— xo - (y— yo = Gt y — xo— yo) (x— y — xo^ yo) 


then W is a pair of straight lines passing through (xo, yo). We also often 
encounter the case when, at least in a sufficiently small neighbourhood of 
(Xo, Yo), the set W is a curve described by a continuous (one-valued) function 


y = wx. X € (Xo— Ô, Xo+ ô) 


In this connection there arises the question as to how we can find which of 
the cases takes place judging by the properties of the function f. Below are 
two theorems giving answers to this question. 


Theorem 1. Let an equation - | 
I(x, y) = 0 (1) 
satisfy the following conditions. 

The function f is defined in a two-dimensional neighbourhood £2 of the point 
(x*, y?) in the xy-plane and is continuous in that neighbourhood together with 
its partial derivatives of the first order; the derivative of f with respect to y is 
different from zero: 
zt z 0 (2) 
Besides, let f(x", y?) = 0. 

Let M be the set of all points (x, y) satisfying equation (1) (in particular, 
Qe, y?) € M). 


Then for any bo > O there is a rectangle 
A = (Ix—29| < a, 1y—y?| < b}, D = bo (3) 
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belonging to Q such that the set M A (the intersection of W and ^J) is described 
by a (uniquely determined) continuously differentiable ( one-valued) function 


y-y(X xe A? (4) 
d? = (Ix—-xo| < a} (5) 


In other words, the rectangle A possesses the property that on its projection 
4l" on the x-axis it is possible to define a continuously differentiable function 
(4) satisfying equation (1): 


T(x, ps) =0, xed (6) 
Its graph is entirely contained in 4. This function is determined uniquely in 


the sense that the coordinates of any point (x, y) € M A are connected by 
equation (4). In particular, y? = y(x) because (x?, y?) € W.. 


where 


Theorem I’. Let an equation 
f(x, y) = fis, eo. Xn, J) = 0 (1') 


satisfy the following conditions. 
The function f is defined in a neighbourhood Q of a point (x", y") = (x9, ... 
. «5 X8, y?) belonging to the space Ry4 1 of points (x, y) = (xy, .. -+ Xn, y) and is 
continuous there together with its first-order partial derivatives; the derivative 
with respect to y is different from zero and the function itself is equal to zero at 
(x°, y"): 
9f 0 0) — 2^ 
y”? and f(x, y®})= 0 (2) 


Let Wt be the set of all points (x, y) satisfying equation (1°) (in particular, 
(x9, y?) € M). 
Then for any bo > 0 there is a rectangle 
d= {xx <a, j21l...n ly-y?| < 5}, bebs (3) 


lying within Q such that the set MA is described by a (uniquely determined) 
continuously differentiable (i.e. having continuous partial derivatives) func- 
tion SEPA eset us Mud 

y = w(x) = vx .... Xa) x € de (4) 
where 

æ -i(x-x-a j=l,...,n} (5') 


Proof of Theorem 1. Without loss of generality we can suppose that €? is a 


domain, that is a connected open set. Since ay is continuous on 2 condition 


(2^) implies that a retains sign throughout £2. For definiteness, tet S£ >0 


on Q. Then, by the conditions of the theorem, there is b > 0 (b < bo) such 
that the function /(x®, y) of one variable y is continuous on the closed inter- 
val [y?— b, y°+5] (x = x°), is strictly increasing on that interval and turns. 
into zero only at the point y = y? (/(x*, y?) = 0). It follows that f(x°, »*— b) — 
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< O and f(x, y°+5) > 0 and, by the continuity of f, there is a sufficiently 
small number a > 0 such that f(x, y?— 5) < 0 and f(x, y?-- b) > 0 for all 
x € Æ and such that 4 c Q (see (3) and (5)). 

Now we choose an arbitrary point x € Zl?, fix it temporarily and consider 
the function f(x, y) of one variable y on the interval (j9— b, y*-- b). By the 
properties of f, this function is continuous, strictly increasing (since a > 0) 
and assumes values of opposite signs at the end points of the interval. There- 
fore there exists a single value y € (y9— b, y°+5) which we denote y = y(x) 
for which f(x, y(x)) = 0. 

We have thus proved the existence of a function y(x) defined on /? and 
satisfying all the conditions of the theorem except the continuity and the 
continuous differentiability since they have not yet been proved. 

Let us prove that the function y is continuous. To this end it is sufficient 
to show that it is continuous at the point x = x^. Indeed, the same proof 
can then be extended to any other point x’ of the interval 4° because the 
point (x', y(x’)) can be enclosed in a neighbourhood £2' C 2 such that all 
the conditions of the theorem are fulfilled for it if 2, x? and y® are replaced 
by 2’, x’ and y' = y(x’) respectively. 

Let us take a number f > 0. Without violating generality we can assume 
that £ < b. By what has been already proved, there is a rectangle 4, = 
= {|x| <2, |y—y?| < 8'), a <a, B' < B anda function y = y, (x), 
x € A® = (| x—x?| <a}, which describes the set MA,- 

We have 4, c 4 and therefore, obviously, y(x) = y,(x), x € 49. This 
shows that for any f >0 there is a > 0 such that |y(x)— y(xo)] « P 
provided that | x— x?| < æ, which means that y is continuous at the point 
x= x, 

To complete the proof we must show that the function (x) possesses 
dy 
dx 
Let x, x+ Ax € A, y = p(x) and 


Ay = y(x+Ax)— (x) (7) 


the continuous derivative with respect to x. 


Then 
0 = f(x+Ax, yt dy) fo y) = (ta) dx+ (tea) dy (8 


If we pass to the limit as dx — O in this equality then, as is already known, 
Ay — 0; consequently, by the differentiability of f at the point (x, y), we 


have £1, £2 — 0. Since 2 > 0 we also have $t £a > 0 for sufficiently small 
Ax, and therefore 


of of 
= +8 poeta 
4y ee ES 
ae af? Ax +0 (9) 


oy ^ e» 
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We have proved the existence of the derivative y' at the point x and the 
equality 


of 
x) = — DE. _ _ fs v(x) 
VG) = — oF = — f we) (10) 
oy 


The continuity of y'(x) is directly implied by this formula because f; and 
Jare continuous in the rectangle 4 and the curve y = y(x) whose continuity 
has been already established does not fall outside it. 

Proof of Theorem 1'. This proof is analogous to the above but we must of 
course consider the vector variable x instead of x and take IN, A and 4° 
mentioned in Theorem 1’. Further, in place of (7) we should take the incre- 
ment 


Ay = 1, -o Xj MPAA, Njiti is. Xo) Vas... Xa) 


of the function y at the point x corresponding to an increment 7 of the 
variable x; (j = 1, ..., n); then instead of (8) 


0 — f(x ..., Xn Xi h, Nyaa, o-s Xs y - Ay) -f(x, y) = 





_ (oF Os , 
d (Se ter) ee (res) ar (8) 
we obtain the relation where £1, £2 — O for h — 0. Consequently, 
of of 
—— +E — 
Ov 22009 7 Ox; 2 i 
“Ox ==> lin as ERES 72 (j= 1,...,7) (10) 


: Əy 
Theorem 2. If a function f (x, y) (J (x, y)) satisfies the conditions of Theorem 
| (Theorem |’) and, besides, possesses continuous partial derivatives of order 
lon Q, the function y(x) (y(x)) mentioned in Theorem 1 (Theorem 1°) possesses 
continuous partial derivatives of order | on A. 

Proof. On differentiating (10) with respect to x we get 

_ fM tV fai Ue v fon] (11) 
Si 

where (x, y) should of course be replaced by (x, p(x)) in all partial derivatives. 

The right member of this equality is a continuous function of x and hence 

y" (x) is continuous. 

On differentiating repeatedly the required number of times we obtain as ul- 
timate result that the derivative w(x) is a rational expression in the partial 
derivatives of f up to order / inclusive and in the derivatives y, .. ., y (79 
whose continuity has been established in the foregoing differentiations. The 
denominator of this rational function is different from zero (by virtue of 
the condition f; z 0) and therefore the derivative p(x) exists and is con- 
tinuous. 


(x) = 
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In the cuse of Theorem 1’ equality (11) is replaced by 


ay ae JM are Fe Ur efl (eis 
Ox, Ox, fF 
(see (10’)). 


Example. The left-hand side of the equation (y —x)* = 0 has continuous 
partial derivatives but the derivative with respect to y turns into zero for 
X = y = 0. Despite this fact the given equation possesses the unique solu- 
tion y — x assuming the zero value at the point x — 0. Hence, Theorem 
l only provides sufficient conditions for the existence of a uniquely deter- 
mined implicit function whose graph passes through the given point (x°, y), 
and these conditions are not in fact necessary. 


§ 7.17. Existence Theorem for the Solution 
of a System of Equations 


Theorem 1. Ler a system of equations 
f(x rm Pis 2 Jn) = fin y) 0, j= l, 2, M (1) 
satisfy the following properties. 
The functions f; are defined in an ((n-+-m)-dimensional) neighbourhood Q 
of a point (x9, y?) = (x9, ..., x9, 9, ..., Y2) belonging to the space Raym of 
points (x, y) = (Xi, ..., Xi, Yis -- -s Ym) and are continuous there together 


with their partial derivatives of the first order, and the functional determinant 
( the Jacobian" ) 


90A | 8^ 
oy, Pt 8y5 
DU, f i 
Dy. (Jn) mj... 
ME 
Oy, eae ay, 
is different from zero: . : 
Difin Sa on | 
Bos sr Q) 


Besides, let the point (x°, y?) satisfy system (1). 

Let W be the set of all points (x, y) satisfying system (1) (in particular, 
(25,9) € M). 

Then for any bo > O there is a rectangle 


A = (Ixi- xil -üaG,i-l,...,n, Ixj—-511 <b,j= 1; m}, b < bo (3) 


belonging to Q such that the set MA is described by (uniquely determined) 
continuously differentiable functions 


y = v(x), j=1,... m, x EI (4) 


* After K. G. J. Jacobi (1804-1851), a German mathematician. 
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where 
A = {ixa = a; I 224) (5) 


In other words, the rectangle 4 possesses the property that it is possible 
to define, in its projection 4° on the coordinate subspace (xi, «sey Xa), 
(one-valued) continuously differentiable functions (4) satisfying equations (1), 
i.e. 


f(x: (Qs ..svu(x)m0 xcd,  jzl...m (6) 


and the inequalities |y(x)—y?| <b. These functions are determined 
uniquely in the sense that the coordinates of any point (x, y) € Mt 4 are 
connected by equations (4). 

In particular, y? = p,(x°), j = 1, ..., m because (x°, y?) € MJ. 


Remark 1. We can also use the following formulation which will be 
convenient for our further aims: the points of the form 


(x, y) = (x, p(x), oO Yn(X)), =x € A? (7) 


belong to Aand satisfy equations (1) (i.e. (x, y) € M 4); there are no other 
points belonging to A and satisfying equations (1), i.e. if (x, y) € M Athen 
(x, y) has form (7) for some x € A’. 


Remark 2. It is allowable to assume that the rectangle A and its pro- 
jection A® mentioned in the theorem are specified by inequalities 


d= {ixa -a,i-l,...mnm lyj—J9 | = j j =1,..., m) (3) 
and 
A = (ixi-xb| < aj,i = 1,...,n} (5°) 


where, generally speaking, a; and b; are different numbers. For if the theorem 
holds for rectangle (3’) with some a; and b; then, putting b = min b, and 
taking into account the continuity of the functions y;, we can find a number 
a<, i= l, ..., n, such that the points (x, yi(x), ..., Yn(x)) where 
x € {|x xf] «a, i = 1, ...,n)areinrectangle(3). ^ 

However, it should be noted that in the general case it may be impossible 
to choose a and b in (3) so that they are equal; this is readily confirmed by 
the example of the equation F(x, y) 2 y—x? — 0 considered in a neigh- 
bourhood of the point x, = y, = 0. 

Proof. For the case m — 1 the theorem was already proved (see $ 7.16, 
Theorem 1^). Let us suppose that it holds for m— 1 (m > 1) and prove that 
it then holds for m. 

_ The Jacobian (2) being different from zero at the point (x°, y®), one of 
its minors of order m—1 is also different from zero at that point; since this 
minor is a continuous function there is a sufficiently small neighbourhood 
of the point (x°, y?) in which it is different from zero (without loss of gene- 
rality we can assume that this neighbourhood coincides with 2 because, 
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if necessary, the original neighbourhood 2 can be diminished). For defi- 
niteness, let us suppose that this minor is 


DA, oe -s fn-i) 


DUI E AES e (8) 


By the hypothesis, the theorem holds for m— 1 and therefore, taking into 
account (8), we can apply it to the first m— 1 equations (1) and thus conclude 
that for any bo > 0 there is a rectangle 


d= {ixi- 3l <2,j=1,...,4", 1Ym— Y» <B, lyri | <=, 
i=l, ..., m—1}, y < bo (9) 
lying in the space R,,,, and belonging to 2 such that the set It’ of points 
(x, y) = (Qi... Xm Yi» ---s Ym) belonging to 4 and satisfying the first 


m—1 equations (1) is described by (uniquely determined) continuously 
differentiable functions 


= PAX, yu), j= 1,...,m—1, (x, Yar) € 4, 


IO 
Y= (x x?! < Z, i= 1, stony dls |»» — 5. « p) ( ) 

Thus, in particular, 
9) = p, y») j2lh...m-1 (11) 


Remark 3. At the above, first, stage of the argument we can take « = f 
but at the next stage this may be, generally, impossible, and it may happen 
that the numbers « and f should be decreased different numbers of times. It 
is easily seen that such a decrease does not violate the validity of what has 
already been proved. 

Thus, functions (10) satisfy on A’ the first m— 1 equations (1), that is 
there hold the identities 


A(x, 91 (X, Ym), +e ey KVn- (XS Ym) Ym) = 0, (X, Ym) € A^, 
jim Bante (12) 


Let us substitute these functions into the mth equation of system (1). 
This leads to the equation 


F(x, Ym) = In; p(x, Ym), n Pm—1(X, Ym), Ym) =0 (13) 


which specifies implicitly a function y,, = Ym(x) whose existence, however, 
is to be proved. In the proof we shall use the following properties: 

(i) The function F(x, Ym) is defined in the rectangle A’ and has continuous 
partial derivatives there because functions (10) possess these properties; 
the points (x, y) specified by these functions lie within the rectangle 4 where 
the function /,,(x, y) is continuously differentiable. 


(i) F(x*, y) = Sah, u(x, Vh) -+ -s Pm—1(X"s y), y) = Fn X°, y?) = 0. 
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(iii) The partial derivative of F with respect to y, is different from zero 
in some neighbourhood of the point (x°, y9.) of the space (x, Ym): 
OF 
On (4) 


Property (iii) follows from the argument below. 
Differentiating (on 4’) functions (12) and (13) with respect to Ym we obtain 























Of 0p. Of, Ov, , 95. P i 
now t Oy oy ta = = 0, j=l, ...,a-1 
OF _ Ofna ogi a+ 9f, : n-i + D Sin 
Wn ~ OV 1 On ` ey, mot "Oy, m 9y, m 
Therefore on adding to the mth Pd of determinant (2) its jth columns 
(jo 1, ..., m— I) multiplied by SU. we receive 
| 20185 5. gf 
Oh BA | ye BO 
[s ET Aput OPa —esesexsensy emen sim 
Pa Eua d ma eus = dfaa GAAN 0 z 0 
10f.. 9f, Dfa oy, ev 
[99 7^ Oyai Wa | of, afa OF 
Oy» FAM BY m 





whence, by (8), it follows that £ = 0. 


The theorem follows from properties (i)-(iii). 

Indeed, let M” be the set of points (x, y,) satisfying equation (13). 
Since the theorem holds for m = 1 (see Theorem 1’, § 7. 16) we see that, by 
properties De Se there exists a rectangle A’ = (1xj—»?| <2, j= 1, ... 
m—1; |yn—y®| < B) which (see Remark 3) can be regarded as being 
found at the yes stage of the argument (see (10) where x and f should be 
accordingly reduced), and there exists a (unique) continuously differen- 
tiable function y,, = (x) defined on 


a -(x-xib-x-j-k..sn (15) 
which describes the set J2’’2I’. 
Thus, 
Sinks P(X, va), . -s Pn— 1%, Pal), l) = 0, — xc (16) 
Let us put 


yx) = P(x, vo(x), J = 1, oa m—-l, yox) = ym(x), XEL (17) 

The functions yj;(x) satisfy the conditions of the theorem. 

Indeed, the function Ym = v,,(x) possesses continuous partial derivatives 
in d°, and the points (x, v,(x)) of the coordinate space (x, Ya) do not fall 
outside the rectangle 4’ on which 9,(x, Ym) are continuously differentiable, 
20006— 18 
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which implies that the functions y;(x) (j = 1, ..., m — 1) are continuously 
differentiable on 4° as well. Besides, by virtue of (17), it follows from (12) 
and (16) that A(x, P(x), ..., Po(x)) = 0,j = 1, ..., m, x € A. 

Thus, we have proved the theorem under the assumption that A and 4^ 
are chosen in accordance with (9) and (15). But, by Remark 2, it is clear 
that the theorem also holds for some a, 6 > 0 in its original formulation. 

Let us show that if a point (x, y) belongs to 4 where J is the rectangle 
defined in (9) and if W is the set of points (x, y) satisfying system (1) then the 
coordinates of the point are connected by the equalities y, = p(x), x € A, 
j=1, ...,m (this property follows from the above consideration but we 
want to present here its independent proof). 

If (x, y) € MA then (x, y) € MWA where W is the set of points (x, y) 
satisfying the first m— 1 equations of system (1). Therefore there hold the 
relations 


j= qii, Yn) (x, Y.) € Ar, j= l, EA m-—1 (18) 


and, since the point (x, y) € NA satisfies the mth equation (1) as well, we 
see that, by virtue of (18), (x, Ym) € M” where W is the set of points satis- 
fying equation (13), that is (x, Yin) € WN. Therefore Ym = wa(x), x € A 
and y; = p(x, v«(x)) = p(x), x € 4, j 2 1, ..., m—1. 


Theorem 2. Jf, in addition to the conditions of Theorem 1, the functions f; are 
I times continuously differentiable on 2 the solutions to the given system, that is 
the functions (x), x € A, j= 1, ..., m, are also | times continuously 
differentiable on A. 


This theorem is proved by analogy with Theorem 2 in§ 7.16. 


§ 7.18. Mappings 
Let there be given a system of continuously differentiable functions 
yj = FAX) = OX, o -r x). x € Q; j2lL...m (1) 


where € is an open set of points x = (xi, ..., Xm)- 
We shall say that system (1) specifies a continuously differentiable mapping 


y= Ax, x€Q (1’) 


of the set Q on the corresponding set {2’ of points y = (Yı, .. ., Ym). We shall 
also write Q'— A(Q) and call Q’ the image of Q and Q the preimage (or the 
inverse image) of Q' (under the mapping A). 

Together with A let us take another continuously differentiable mapping 
B of an open set A of points y on a set of points z = (zi, ..., Zm) determined 
by some functions 


zj = WAI) = vios Yn). ye aA, j2M2,...,m 
Thus, z = By, y € A. 
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If 2 C A* we can consider the composite continuously differentiable 
mapping z — ns x€Q, ee by the equalities z; = y; (gi(x), ... 

s 9X), x € Q(j— 1, 

The Jacobians of the ABL A, B and BA are connected by the impor- 
tant relations 














Dln air Ea) j | y ay, 
D(xy. ..., X4) 0x Fer ey, Ox; 
= Oz, oy, = D(z; ooer Zm) DOi -s Ym) (2) 
oy, Ox; Di, mE Jm) D(x, DET Xm) 














(where !...| is the symbol of the determinant) whose proof, as we see, is 
based on the application of the differentiation formula for a composite 
function and on the multiplication rule for determinants. 

In par euler, if B is the inverse (the inverse mapping) of A which mapé the 
set A(O) on the set of points x € Q, that is if x = BAx (x € Q) is the 
identity mapping, then, since its Jacobian i is equal to 1, we receive the formula 


m D(yy .... Ya) D(xy -c5 Xm)? xeu (3) 


Now we shall suppose that the Jacobian of the continuously differentiable 

mapping y = Áx specified by equalities (1) is different from zero** throughout 
i D ee <Ja) 

the Open set Q: Dan.. X.) 
following properties: 

(1) Q’ = A(9) is an open set (together with £2!); 

(ii) if £2 is a domain (i.e. a connected open set) then Q is also a domain; 

(iii) the mapping A is locally one-to-one, that is for any point x? c £2 
there is a ball V € Q with centre at that point such that the mapping A, 
considered only on V, is one-to-one. 

Let x? € Q and y? = Ax? € 2’. Let us denote by Rs, the space of points 
(x, y) = (Xn ... Ming Yis --- Pm) and consider in it the equations 


fx. y= PAX, " ” Xm)— Yi = 0, icl...,m 


connecting the coordinates X1,- ., Xm Y .-., Jo. The point (x9, y?) is sure 
to satisfy these equations and the functions f; are continuously differentiable 
in a neighbourhood (in the space Rz») of this point, the Jacobian of the 
functions f; satisfying the condition 


Dif, o Sm) = Dipi... » 92) 
D(x, eee Xm) z Dixi.. * +> Xm) T 9 


Therefore, by virtue of Theorem 1 proved in the foregoing section, for any 
bo > O there are positive numbers a pand b < bo such that the set of points 


# 0, x € Q. Our immediate aim is to prove the 


* Note that if x? € 2 and p? = Ax? c A then, by the continuity of A, there is a 
neighbourhood Vz» of the point x? whose image under the mapping A belongs to /l. 
Reducing 2 by putting 2 = Vz we then obtain Q' c 4. 

** The case when the Jacobian of mapping (1) turns into zero will be studied in § 7.27. 


18 
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(x, y) belonging to the rectangle 
dax 


where 
HA = (1xj—52] <a j=l, 2. In} and 


Ay = {xx < bf = 1, ...,m} oc Q 


and satisfying equations (1) is described by continuously differentiable fun- 
ctions 
x= p(y), year (i9 1,...,m) 


Consequently x € 42 when y € 4. Let us denote as x = By (y € lı) the 
continuously differentiable mapping determined by these functions. 

What has been said can be expressed as follows: 

(a) if y € A; then x = By € d»; 

(b) if y = ABy then y € 4; 

(c) relations x € “lo, y € Ai and y = Ax imply x = By. 

Let B(Z4,) = œ. By (a), we have w Z zla — Q and, by (b), we have Aw = 
= A, co. 

Thus, every point y? € Q is contained in an open cube <h c 2 and 
therefore is an interior point of 2’. We have proved property (i): Q’ is an 
open set. 

By (b), the Jacobian of the transformation from y to x under B is different 
from zero (see (3)) on the open set 4,. Hence, applying property (i), which has 
already been proved, to B and A; instead of 4 and Q we conclude that the set 
o of points x is open. 

Consequently the operator" A maps the open set w onto /h = w. 

Let x’ and x” be some points belonging to w for which Ax’ = Ax" = y. 
Then x’ € œ C Ap, y € Zi and, by (c), x’ = By. Arguing similarly we also 
obtain x” = By, i.e. x’ = x". In particular, this shows that 

(d) BAx = x, x € o. 

This means that the mapping of the open set œ onto /l; determined by 
the operator A is one-to-one. In particular, A specifies a one-to-one mapping 
of any ball F << c with centre at x°, which proves property (iii). 


Remark. Properties (c) and (d) express the fact that the operators A and 
B are mutually inverse. 

Now let us suppose that 2 is a domain; then, by property (i) already 
proved, 92’ is open together with Q. If we take two arbitrary points y’, 
y" € 2 then the Pi x’, x" € Q corresponding to them are such that 
Ax' = y' and Ax" a ue set 2 is connected and therefore there exists a 
continuous curve a6) € 2. Q, 0 =z = l such that x(0) = x' und x(1) = x" 
which belongs to 2 and joins the points x’ and x”. Consequently the curve 
y(t) = A[x(O], 0 <7 <1, which is obviously also continuous, belongs to 


* In modern mathematics the terms "operator", "transformation" and "mapping" 
(and also function") are used synonymously. — Tr. 
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Q' and connects y' with y". Hence, Q’ is a connected open set, that is a 
domain, which proves property (ii). 

Property (iii) expresses the fact that the mapping 4 is only locally one-to- 
one (as we say, one-to-one "in the small") because, generally speaking, it 
may not be one-to-one throughout 2 (one-to-one “in the large"). For exam- 
ple, the transformation x = o cos 0, y = osin 4 from polar coordinates o, 0 
of the points of the xy-plane into the Cartesian coordinates x, y is conti- 
nuously differentiable and has the nonzero Jacobian equal to o for o > 0 
and any 0. It maps the points (0, 0) (p > 0, — œ < 0 < œ) of the (auxiliary) 
o0-plane distinct from the origin onto the points of the xy-plane in a locally 
one-to-one manner. However, although to each such point (x, y) there 
corresponds a single value of o the number of the corresponding values of 
0 which differ from each other by 2k (k = 1, £2, ...) is infinite. 


8 7.19. Smooth Surfaces 


Let R be the three-dimensional space with rectangular Cartesian coordi- 
nates (x, y, Z). : 
If G is an open set in the xy-plane and 


z=f(x,y) — (Q»«G) (1) 


is a function having continuous partial derivatives of the first order on the 
set G, then the set S C R described by this function is referred to as a smooth 
surface. 

We shall say that this surface is projected on the plane z = 0. Equality (1) 
establishes a one-to-one correspondence S = G between the points (x, y, z) € S 
and the points (x, y) € G. 

If G is a bounded domain (i.e. a connected open set) with a boundary y 


and if the partial derivatives E and x arc not only continuous but also: 


uniformly continuous on G, the function f and its partial derivatives can 
be continuously extended to y. The set described by the extended function 
z= f(x, y), (x, y) € G (we denote it by the same letter f) will be denoted S. 
The set /' = S—S is called the edge (or, sometimes, the boundary) of S (and 
of S). The set S will be referred to as a smooth surface with edge. It is obvious 
that the projection of /" on the plane z = O is the set y. 

If y is a piecewise smooth curve (contour) described by equations 


x-9g(s) y-ws (O=s5< 50) 
then I’ is also a piecewise smooth curve represented by the equations 
x-29() y=), z-/(g(s,w(s) Oss = 50) 


It will be called the boundary curve of S (and of S). In this case we shall call 
S a smooth (surface) element with (piecewise smooth) boundary curve or, 
briefly, a smooth (surface) element. 
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If Ao = (xo, yo, Zo) is an arbitrary point of a smooth surface represented 
by an equation of type (1) then, since G is an open set and the function f is 
continuous, for any 62 > O there is 6, > O such that the rectangle (rectan- 
gular parallelepiped) 


d= (Ix— xol = ôn |y—yol = ôn |z—zol = 04) Q) 


cuts from S a smooth element ø (with boundary curve) specified by the 
function 


z = f(x y) (a, 3) E 4), d = {|x xo] = ôn |y= yoi 50) = G 


where I’ is the projection of 4 on the plane z = 0. 

If Ag is a point of the boundary curve /' of a smooth surface element S 
we can only assert that there is a three-dimensional rectangle 4 of type (2) 
with centre at Ao cutting from S a portion o described by an equation z = 
= f(x, y) (x, y) € w where w' isa part of J’. 

The definitions of a smooth surface and of a smooth surface element 
are extended, by analogy with the above, to the cases when the surfaces 
are described by equations of the form x = V/(y, z) or y = QX-, x), that is 
when they are projected (in a one-to-one manner) on the plane x = 0 or 


Now we shall generalize these definitions to the case of surfaces which, 
generally, cannot be projected as a whole on any of the coordinate planes. 

We shall say that a set S c R is a smooth surface if for its any point 
A9 = (x9, y*, z9) there is a (three-dimensional) rectangle 


A = {|x—x*| = ðn |y—y®] « ós |z—z"] = à) 


cutting from S a smooth element o which can be described by an equation 
belonging to at least one of the three types 


z=filxy) — (Ix—o0b às |y—y"| = 63} 
x=feQyz) — {ly—y"| < òr [2-2] = by} (3) 
y =fa(z, x) (Iz—z9| = às, |x-— x?| = 4j) 
Since we refer to ø as a smooth surface element we thus mean that the 
functions fi, f2 and fa have continuous partial derivatives in the correspond- 
ing closed rectangles. 
For example, let there be an arbitrary function F(x, ), z) defined on a 


three-dimensional set R C R and continuous together with its partial 
derivatives of the first order such that 


(S) (S) +(e) =o (ne (a 
Let us denote by S the set of points A = (x, y, z) for which 

F(A) = F(x,y,2) = 0 (5) 
If the set S is nonempty it is a smooth surface. 
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Indeed, let Ao = (Xo, Yo, zo) € S. By (4), at least one of the e 
tives of F is different from zero at the point 4o; for definiteness, let (s c =), =~ 0. 


Then, by the continuity of the partial derivatives of F, we conclude, on the 
basis of the existence theorem for implicit functions (see § 7.16, Theorem 1^), 
that there exists a three-dimensional rectangle 


E= (Ix xal, yoj <= 6; !z—za] ex 7). (6,2 > 0) 


cutting from S a portion c represented explicitly by a continuously differen- 
tiable function 


r= yyy (SIEM, lu (x-xes eroi (6) 


This means that æ is a smooth surface elcment with boundary curve. 
The smooth element and the surface S have a tangent plancat the point Ay 
whose equation is (see § 7.5 (13)) 





20 (SE) 5 (FE) i59 (7) 
By virtue of the equalities 
eS Ges 
(s), á (sz), 
(see $ 7.16 (10")), equation (7) can be rewritten equivalently as 
(S5) G9 (27), 0799 ($5), (2-20) = 0 (8) 


The spherical surface 
+ y?+z? LR (R > 0) (9) 


is a smooth surface because if a point Ay = (Xo, Vo, zo) belongs to S then 
one of its coordinates, say zo, is different from zero and therefore, us can be 
easily shown, there is a three-dimensional rectangle 


4 = (Ix— xol, l»y— J'o | <4, [z— zo] = : A} (6, 4-90) 


cutting from S a smooth element ø described by the equation 


z = f(x, y) = sgn zo V Rt—-x?—y* (Ix— xoi, |y —yo| = 5} (10) 


where the function f(x, y) in (10) possesses continuous partial derivatives. 
In this example we can also use another argument. Let Q c R, be tne set 
determined as 


Q = (RP = x+y x (Ry) 
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where 0 < R' < R < R". This is an open set entirely containing the. 
spherical surface S. T he fonction on the left-hand side of (9) has continuous 
partial derivatives on 2 which do not vanish simultaneously. Therefore, 

according to what was ed above, S is a smooth surface. 

By the edge of a smooth surface S is meant the set l = S—S provided 
that it is nonempty. Thus, a smooth surface S has no edge if and only if it is q 
closed set. 

The functions 


z= x+y (— œ < x,y <œ), 
z = tan x tan y (—2/2 = x, y < 2/2), 
z —sinx (— œ< x <æ) 


describe unbounded smooth surfaces without edge. The third of them is 
specified by a bounded function but the corresponding surface (set) is 
unbounded. 

The spherical surface S is a smooth surface and at the same time a closed 
set; it has no edge. If we delete from S a point Ao belonging to it the remain- 
ing set is obviously a smooth surface S with the edge consisting of that 
single point. 

If a part of a surface S (which may coincide with S) is the closure of a 
smooth connected surface with piecewise smooth edge we shall say that it is a 
smooth surface with edge cut from S. 

The part S, of the spherical surface S (represented by (9)) consisting of the 
points (x, y, z) withz > Oisa smooth surface. Its edge I is the circle x?+y?= 
= R3, z = 0. The closure $, = $1+J of Sı is the upper hemisphere (with 
edge) described by the function z — f(x, y) — V R2— x — y?, x*-p y? e R 
It is a smooth surface with edge cut from the surface S. The function 
z = f(x, y) is continuous in the disc (closed circle) x?-- y? = R? but its 
partial derivatives are only continuous in the open circle x?+y? < R?andare 
unbounded in the vicinity of its boundary. Hence, although S, is projected 
on the xy-plane, the corresponding function representing S; (when extended. 
to the closed circle) is not continuously differentiable on the boundary of that 
circle. Further, S, cannot be projected (in a one-to-one manner) on any 
other coordinate plane. Thus, S, is not a smooth element (with piecewise 
smooth boundary curve). On the other hand, it is readily seen that S (and S1) 
can be cut into a finite number of smooth elements. 

A surface which can be cut into a finite number of smooth elements is 
called piecewise smooth. 

The surface of a rectangle (rectangular parallelepiped) is an example of a 
piecewise smooth surface which is not smooth. 

Finally, we note that, in accordance with the terminology of Chapter 17, 
a smooth surface understood in the sense of the definition stated in this 
section is a two-dimensional differentiable manifold in the space Rs. 
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§ 7.20. Parametric Representation of a Smooth Surface. 
Orientable Surface 


As we know, a smooth surface can be represented in an explicit form 
(e.g. see 8 7.19 (1)) or inan implicit form (see 8 7.19 (5)). The definition of an 
arbitrary smooth surface says that it can always be represented locally 
explicitly. There is another important method for the representation of 
smooth surfaces, namely the parametric representation. 

Let us consider the three-dimensional space R with rectangular coordi- 
nates (x, y, 2) and an auxiliary plane W with rectangular coordinates (u, v) 
where u and v are parameters with the aid of which a smooth surface will be 
represented. Let 2 C W be an open set and let three functions 


+= plu, v), yv (u, v), z= x(u, v) (u, vy € Q (1) 


of the parameters u and v be defined in it. Relations (1) can be written in the 
equivalent vector form 
rs gityjt zk (2) 


We shall suppose that the functions p, y and y possess continuous partial 
derivatives in 2 and that the inequality 


axil = (FER) + (FAS) e (SY > o 


is fulfilled throughout 2. 

The locus S of points (x, y, z) specified by functions (1) is called a ( smooth) 

surface. To express the fact that S is represented by functions (1) with the 
indicated properties we shall say that the surface S admits of a smooth 
parametric representation with the aid of the parameters (u, v) € Q. 
- A surface S admitting of a smooth parametric representation in the sense 
of the above definition is by far not always a smooth surface (differentiable 
manifold) in the sense of the definition stated in the foregoing section but 
there is a simple sufficient criterion for S to satisfy both definitions. 

Namely, if equations (1) establish a one-to-one correspondence Q5 (u, v) = 
= (x, y, Z) € S then the system of functions (1) considered in an arbitrary 
domain Q' c O c Q represents a smooth surface (two-dimensional differ- 
entiable manifold). 

Here we shall not prove this proposition. It follows asa special case from a 
more general proposition proved in$ 17.1, Vol. 2, Lemma 1). 

Inequality (3) implies an important fact. Let (u®, v?) € Q be an arbitrary 
fixed point of the domain 2 in the plane of the parameters u and v. One of the 
determinants in (3) is different from zero at this point; for definiteness, let 
it be the first one. Then there isa neighbourhood w c Q of this point such 
that the first two equations (1) are uniquely resolvable with respect to (u, v) in 
w. On substituting the corresponding functions expressing u and v in terms of 
x and y into the third equation we see that there is a portion o c S described 
by a continuously differentiable function z = f(x, y) defined in a domain A of 
the xy-plane A 3 (x, y) = (u, v) € o. 











(4v)€Q (3) 
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This shows that for any point (u?, v") there is its neighbourhood w c O 
such that the portion o C S of the surface S corresponding to it is projected 
(in a one-to-one fashion) on at least one of the coordinate planes. This loca] 
property of a surface having a smooth parametric representation is extremely 
important but it should be stressed that the condition expressing it is weaker 
than the condition imposed on a smooth surface (two-dimensional differen- 
tiable manifold in the space R3) in the definition given in the foregoing 
section (see Example 1 below). 


Example 1. Let us consider the surface S (Fig. 7.5). lt can be thought 
of as being obtained from a rectangular sheet of paper J (shown as occu- 
pying the domain (0 < u <a,0 < v < b) intheuv-planein Fig 7.6) by twisting 
it smoothly so that it intersects itself along the line segments u = uj, u = us 
which are made coincident. A real model of such a surface can be made if 


D 





C O u Us a uv 
Fig. 7.5 Fig. 7.6 


we cut the sheet A into two parts along the line u = u» and then paste them 
together as shown in Fig. 7.5. To every point of this surface S we assign as its 
parameters (u, v) the coordinates of the corresponding point of the rectangle 
A in the original uv-plane. Then each point of the line segment CD c S will 
correspond to two pairs of values (vı, v) and (us, v) of the parameters. 
Therefore, we can say that S is a surface (represented parametrically) inter- 
. secting itself. From the point of view of the terminology of the foregoing 
` section the surface S is not smooth since any rectangle (rectangular parallele- 
piped) with centre at a point P € [C, D] cuts from S a part which cannot be 
projected in a one-to-one manner on any of the coordinate planes. On the 
other hand, every point P € [C, D] can be regarded as corresponding to two 
points (u1, Yo) and (us, vo) of the uv-plane and both points can be enclosed in 
circles (discs), belonging to the uv-plane, with centres at these points and 
sufficiently small radii so that each of the portions 0), 02 C S of the surface S 
corresponding to them can be projected on at least one of the coordinate 
planes. 

It is also interesting to consider the surface S’ C S corresponding to the 
values (u, v) of the parameters running through the rectangle 4’ = (0 <u < 
< us, 0 < v < b). As is seen from Fig. 7.5, S' is a surface without self- 
intersection admitting of a parametric representation (parametrization) 
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because in this case we have the one-to-one correspondence S’ = 4’. But 
nevertheless each P € [C, D] is a singular point of S” since if we take a 
(three-dimensional) neighbourhood Q of P, however small, the part S’22 
of S' belonging to 2 cannot be projected in a one-to-one manner on any of 
the coordinate planes. Thus, the set S", like S, is not a smooth surface. 


Remark. There is another terminological system in which by a smooth 
surface S' is meant a set of points (x, y, z) parametrized with the aid of some 
variables (u, v) by means of equalities (1) where p, y» and y are continuously 
differentiable functions satisfying condition (3). According to this terminol- 
ogy, the points (x, y, z) corresponding to different pairs (u, v} are not identi- 
fied and are considered as different elements of S even if (which is possible) 
they specify one and the same geometrical point (x, y, z). 

Now let us replace the parameters (u, v) of the surface S by some other 
parameters (u', o^): 


u = À (u', v), v = u (u, v) ((u’, v) € 2 =Q)) (4) 


where À and y are continuously differentiable functions with a nonzero Ja- 
cobian 
Diu’, v') 
Du, v) 





#0 ((u, ») € 2’) (5) 


We also suppose that mapping (4) sets up a one-to-one correspondence 
between the points (u’, v’) of the open set 22’ and the points (u, v) of the set 2 
which is also open (see $ 7.18). This results in parametric equations of S 
involving the parameters (', v"): 

x= piu’, v) = p, v^), E (v, v^)), 

y = piu’, v)- yA’, v^, u(u', v^), (6) 

z= yu’, v) = (Au, v), wu’, v^) (Qr, 9") c 2’), 
where 9, y; and 7; are functions continuously differentiable on O' such that 
the inequalities : a 


[Fu XFy |? = (Fe yF e ( D(y, 2) joel D(z, x) | 2 











Dw, wh) ND, v)] NDE, vo). 
Le | ( Des 9 y DL 
=|tuxtel (PEO) >0 (wwe) O 


hold. 

The new parameters (u', v’) with the indicated properties will be referred 
to as admissible parameters for the surface S. 

Let us consider an arbitrary smooth surface S represented parametrically 
by equations (1) satisfying the conditions indicated at the beginning of the 
present section. This surface has a tangent plane and a normal at its every 
point. To derive the equation of the normal in terms of the vector function 
r = gi+yj+ yk we can use the following argument. 

For a fixed value of the parameter v the vector r = r(u, v) describes 

„a curve corresponding to the variation of the parameter x. The vector F,, 
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goes along the tangent to this curve. Similarly, the vector #, is directed along 
the tangent to another curve which is described by the vector function r when 
u is fixed and v varies. 

If the vectors F, and #, are issued from the point (u, v) of the surface S 
they determine the plane containing them which is tangent to S at the point 
u, t. From condition (3) it follows that the vectors f, and #, are not collinear. 
The normal to S at its point corresponding to the given values of u and v is 
therefore specified by the vector 


PXP, = (2t er. ey 2) i+ (2 op Ox =) j (2 Ov Op at) k (8) 


Ou Ov du Qu Ou Ov Ov Ou 
In the normal to S we can take two unit vectors with opposite directions 
which depend continuously on (u, v) € Q: 





5, vo 
mate (Mea) (9) 

To the sign “+” there corresponds one side of the surface S with a con- 
tinuous family(continuously dependent on(w, v)) of unit normal vectors issued 
from its every point and to the sign “—” there corresponds the other side 
of S. 

Now we state the following definition. If from each point A of a smooth 
surface S it is possible to draw a unit normal vector (A) so that the vector 
function a(A) of the moving point A is continuous throughout the surface 
S, then S is said to be an orientable surface. 

A surface for which a definite vector function a(A) of this kind has been 
constructed is said to be oriented (with the aid of n(A)). When saying that S is 
an oriented smooth surface we not only mean that the symbol S designates 
the surface in question as a point set but also the fact that a definite function 
n(A) continuous on S has been chosen. We also say that the function a( A) 
determines a definite side of the orientable smooth surface S, i.e. the side 
from which is issued the family of the unit normal vectors n(.4) continuously 
dependent on A. , 

The same surface with the opposite orientation should be designated 
differently. It is convenient to denote two such oppositely oriented surfaces 
(which coincide as sets of points) by the symbols $, and S_. Of course the 
choice of the side denoted as S, is quite arbitrary but after this choice 
has been made the other side is automatically supplied with the symbol S_. 

A spherical surface is an example of an orientable surface since if, for 
instance, we issue a unit normal vector from an arbitrary point of the spheri- 
cal surface in the direction to the exterior of the ball bounded by the surface 
this vector can be continuously extended to the whole surface. This con- 
tinuation of the normal vector determines a definite orientation of the spheri- 
cal surface. Then the other, opposite, orientation of the spherical surface is 
specified by the unit normal vector directed to the interior of the ball bounded 
by the surface. 

As was shown above, a smooth surface S represented parametrically by 
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equations (1) satisfying the conditions indicated at the beginning of this 
section is orientable. To the sign “+” in formula (9) there corresponds one 
orientation of S and to the sign “—” the opposite orientation. 

It should be noted (see the next section) that there also exist nonorientable 
surfaces. 

What was said allows us to assert that a nonorientable surface cannot be 
represented parametrically with the aid of equations (1) satisfying the condi- 
tions imposed on the functions q, p and 7. 

On the other hand, the definition of a smooth surface S requires that for 
its each point Ap there should exist a rectangle J with centre at this point 
cutting from S a portion o representable explicitly, say, by a function 
z=f(x, X»), (x, y)€4' which is continuously differentiable in the 
corresponding projection of A. Such a portion c clearly has two sides deter- 
mined by the normals a = (nx, ny, #:) with the components 

ng = a en DN D, gH. = + TU, P E UR MAL 
(n nit 7 type t0 ig 
of of 
(> = 4 = 5) 





To the upper signs in these equalities there corresponds the upper side of a 
and to the lower signs there corresponds its lower side. 
Hence, we can say that every smooth surface is locally orientable. 


Example 2. Spherical Surface. The equations 
x = Rcos 0 cos p, y = RcosÜsin y, z = Rsin 6,— œ <0, q- < «c» (10) 


where R > O is a given number specify with the aid of the angular parame- 
ters 0 and g the spherical surface S of radius R with centre at the origin, 
which can be readily checked by eliminating 0 and 9 from these equations. 

In this case the domain of variation G of the parameters (0, p) is the whole 
plane (the auxiliary 0p-plane). The right-hand members of equations (10) are 
continuously differentiable functions of ô and p. The computations show that 


|roxr,| = R®{cos 0| (11) 


It is seen from (11) that we cannot say that the spherical surface S is 
represented smoothly with the aid of the parameters 0 and y throughout the 
plane of these parameters because such a representation fails at the points 
(8, p) for which cos 0 = 0. But this is due not to the surface itself but to 
the chosen parametrization: as we know (see the foregoing section), S is a 
smooth surface and its poles corresponding to the values 0 = + z/2 of the 
parameter ĝ are not singular points. 

Parametric representation (10) results in self-intersection because we 
did not impose any limits on the variation of the parameters. It appears more 
“economical” to take as the range of the parameters the set —/2 < 0 =< 
<2/2, a « p « a--2z where a is a real number. This set is mapped in a 
one-to-one way onto the spherical surface S with its two poles deleted. 
On this set we have |f; X F,! > O. 


by 
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Example 3. Torus. Let us take in 
the xy-plane a circle of radius a with 
centre at a point (b, 0) (0 <a < b). 
The rotation of the circle as rigid 
body in the space (x, y, z) about the 
y-axis generates a surface T called a 
torus (also anchor ring). Let 0 be the 
magnitude of the angle shown in Fig. 
7.1 and p be the angle through which 

Fig. 7.7 the circle in question is turned about 
the y-axis. The surface T' is represent- 
ed parametrically with the aid of the parameters 0 and q in the form 


x = (b+a cos #)cos¢, y-asin6, 
z = (b+a cos 0) sing (0 = 0, p < 27) (12) 
In the Cartesian coordinates (x, y, z) the equation of T is written as 
$ = (fx?+2—b)?+y2—-a? = 0 





where 


obi? ap (aP\2 — re) 2 2 
(Se) 0) + (Ge) = ve bp + ay? > 0 

on T. This shows (see § 7.19) that the torus T is a smooth surface (which is 

quite clear intuitively). 


8 7.21. Example of a Nonorientable 
Surface. Mübius" Strip 


Suppose that the rectangular sheet of paper shown in Fig. 7.8 (thought of 
as if the line segments aa' and bb' which are a part of its boundary were 
removed from it) is twisted once after which its sides ab and a'b' are pasted 
together so that the point a coincides with b’ and b with a’ (see Fig. 7.9). 
The resultant surface is known as the Möbius strip. Yt is intuitively clear that 
this surface is smooth if the sheet is twisted “continuously” and “smoothly”. 
Such a construction can easily be described analytically with the aid of 
formulas but we shall not dwell on this question relying upon the intuition 
of the reader. The line segment cc' marked in Fig. 7.8 is the midline of the 
rectangular sheet of paper. On the Móbius strip to this line there corresponds 
the closed contour cc' (it is not shown in Fig. 7.9) whose points c and c' 
merge. Let us issue a unit normal vector n(c) from the point c in an arbitrary 
direction. After the direction of n(c) has been definitely chosen (among the 
two possible directions) the direction of n(A) is predetermined for all the 
points A € cc’ if it is required that the vector n(A) should depend on A 
continuously. But at the point c' the vector n(c^) has already been chosen 


* A. F. Móbius (1790-1868), a German geometer. 
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b b’ 
a a’ 
Fig. 7.8 Fig. 7.9 


since c and c' coincide. It is easy to see that when the variable point of the 
midline of the twisted rectangle is moved continuously from c to c' the unit 
normal n(A) (where A is the variable point on the Möbius strip moving 
in the midline) tends to — n(c) but not to n(c), and hence the vector function 
n(A) is discontinuous at the point c = c' € S. We see that the Möbius strip 
is in fact a nonorientable surface. 


8 7.22. Local Conditional Extremum 


Let 2 be an open set in the n-dimensional space R, and let f, qi, ..., Pm 
(I =m < n) be functions defined on 2. 

Let us denote by £ the set of points x for which certain equalities (called 
constraints or constraint equations or coupling equations) 


qy(x) = 0 (j5b5...m;m-«n) (1) 


hold simultaneously. 

A point x? € Q is a point of local conditional maximum (minimum) of 
the function f under constraints (1) if x? € E and if there is ô > O such that 
the inequality f(x) = f(x?) (f(x) = f(x°)) holds for all x € E satisfying the 


n 
condition |x—x9| = |/ Y, (x«— x£)* < ô. 


1 

Points of local conditional maxima and minima are referred to as points 
of conditional extremum. 

We shall begin with establishing necessary conditions for a given point 
x? to be a point of conditional extremum. 

Let us suppose that in a neighbourhood of the point x? the functions /, 
94, . - -Pn have continuous partial derivatives. Moreover, we shall assume 


that at the point x? the rank of the (functional) matrix] (S82) l (41, ..., 
k 


m; k= 1, ...,) is equal to m: rank | B). = m. This means that 


among the determinants (minors) of the mth order of this matrix (at the point 
x?) there is at least one different from zero. For definiteness, letit be the minor 


(Sez), (Bet) 
PELT E ed £0 (2) 


(sr), = (ee) 


Thesymbol(. . .)o indicates that x? is substituted for x in the expression in the 


DG, P ey Fm) 
Dixy, one Xado 
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parentheses. By the existence theorem for implicit functions, there is a rect- 


angle 
J= KA", (3) 
P= {Ixy jim hamp d m fx, af] < o,f = meli] 


and (uniquely determined) continuously differentiable functions x; = 
ty (Ning dy «+ +9 Xn) (J= 1,...,m) defined on l” and satisfying (1), i.e. 


PA fli, -<-s is Nmads s Xu) = 0 (j= l.... m) 


where | uj— X?| < ô (j= 1, ..., m). 

Let us substitute the functions ju, . . ., Um for the corresponding variables 
Xj, .. ., Xm into the function f. The resultant expression (we retain the nota- 
tion f for it) is à function dependent only on the (mutually) independent 
variables Xing, ..., Xu: 


F(a s... Hms Nmt ls e.. Xn) = P(Xingds eens X4) 


It is evident that if fattains its local conditional maximum (minimum) at the 
point x? = (xf, ..., X9) then (x,,41, ...,X,) attains at the point (39,3, ... 

. ., AD) its local unconditional maximum (minimum). As we know, for the 
latter case to take place it is necessary that the equalities 

p 
(=), =0 (| 9 mal... n) (4) 

should be fulfilled simultaneously. Here the symbol ( )o indicates that in the 
function in the parentheses we put X,,41 = Xhi ---. Xa = Ny. (We hope 
that this will not lead to a confusion.) 

Now we state the definition of a stationary point of f: a point x" € E is 
called a stationary point of the function f under constraints (1) if equalities (4) 
hold for it or, which is the same, if 


n ao 
dp = ~—) dx, =0 
os (s ) 


for any values of the independent differentials dx, (/ = m-r1,.... 1). 

This definition is equivalent to the following: 

A point x? € E is a stationary point of f under constraints (1) if the total 
differential df turns into zero, that is 


df = bi (52), dx. = (5) 
for all dx satisfying the linear constraint equations 
ð ; 
Y (25), dx, (jo Hh...,m) (6) 
k=l 


Indeed, by the invariance of the form of the first differential, we have 
df = d® where the (dependent) differentials dx, ..., dx,, entering into df 
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ure respectively equal to 
a 
Oty 
dx, = OZ dy, HS 
k 3 Ox, d; (A = l, eu. P) 


j=m+1 


lhese expressions for dx, ..., dx,, and the independent differentials dXm+1 
2... dx, are connected by relations (6). 

Our considerations incidentally provide the method for determining 
stationary points. It reduces to the solution of ;;— m equations (4) with 
respect to (Xm1,---,Xn)- But this requires that equations (1) should be 
resolved in x1, ...,.Xm beforehand. In most cases this method proves practi- 
cally ineffective. A more effective and simpler method is the so-called method 
of Lagrange's multipliers. 

The method of Lagrange’s multipliers is based on the introduction of the 
auxiliary (Lagrangian) function 


F(x) = f()- Y iy lv) (7) 
1 


dependent on the independent variables x = (x4, ....x,) where 2; are some 
constant numbers (Lagrange’s multipliers) which should be determined simul- 
taneously with the coordinates of the unknown stationary point x”. The numbers 
Mi, <- +9 Am are first taken as undetermined parameters, and for the function 
F(x) of the independent variables xi, . . ., x, (not connected by equations (1) 
the problem of unconditional extremum is solved. More precisely, all its 
partial derivatives are equated to zero: 


OF of Bs I Lud, 
On On y ^a (A= Lh ....n) (8) 


System (8) of n equations is considered together witii system (1) consisting of 
m constraint equations. The entire system of n 4-m equations thus formed is 
then solved with respect to the unknowns xy, ..., Nu. A3... ame It turns out 
that to each solution x®,..., x, 29,..., 29, there corresponds the stationary 
point x° = (x8, ..., x?) of the original problem and, conversely, if x? is a 
stationary point then there are values of the multipliers 7%, . . ., 22, correspond- 
ing to it such that equations (8) with these values of 2;. j = 1,. . ., mare satisfied 
by the coordinates of the point x — x". 
Let us consider the n-dimensional vectors 





(grad f)o = (EAN nS (E (9) 
and 
(grad p;)o = (EAR v ESR (j= L...,m) (10) 


The fact that x? is a stationary point can now be expressed as follows. From 
the orthogonality of the vector (dx;,..., dx) to all the vectors (grad q';)o 


20006— 19 
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(i = L,..., m), that is from the fact that system (6) is satisfied, it follows that 
equality (5) is satisfied, that is the vector (dx, . . ., dXa) is orthogonal to the 
vector (grad f)o as well. Therefore, as is known from vector algebra (see the 
lemma below), there are m numbers 21, ..., Żm such that 


(grad f)o = Ai(grad gijot ... +An(grad qo (11) 


In other words, equalities (1) and (8) hold for x = x?, and we have thus 
proved that to every stationary point x? there corresponds a set of numbers 
Ai, . .- An Such that (1) and (8) hold simultaneously. Conversely, if for a point 
x = x? and for some numbers 4), .., 7,, equalities (8) hold, that is if the 
vector equality 


m 
(grad f)o = Y' ^; (grad pio 
i21 
is satisfied, then the fulfilment of equalities (6), that is the fact that the vector 
(dx, ...,dx,)is orthogonal to vectors (10), obviously implies that this vector 
is orthogonal to vector (9), which means that equality (5) holds. We have 
thus proved the converse implication as well. 

To find the answer to the question as to whether a given stationary point x? 
is a point of conditional extremum and what this extremum is (i.e. a maxi- 
mum or a minimum) it is convenient to use the Lagrangian function F. 
Let us suppose that Jacobian (2) is different from zero at the point x?. Then, 
by virtue of constraint equations (1), the variables Xn41, ..., x, can be re- 
gardedasindependent ina neighbourhood of x? while the variables x1, . . ., Xm 
depend on them. For the sake of symmetry we can consider the whole set of 
the variables xi,. . ., x, as being dependent on x,,41, . . ., x,. Proceeding from 
the theory of unconditional extremum, we can derive sufficient conditions 
for the existence of a maximum or a minimum by examining the second 
differential d?f o at the point x? on condition that the independent variables 
ATE mils Xe 

It follows from (1) that ina ee. of the point x? there hold the 
relations dp; = Oand d*g; = 0 (j = 1,..., m). Therefore in this neighbour- 
hood the equalities 


dj = d FAY p; = ken Ya 





a.d dx; D» a F di 
x d: OF ' 
hold for ^; = 2j. Since (S). =0,k = J,..., n, it also follows that 


th= È S ss dxy dxi 


for x = x" and for all dx, satisfying constraint relations (6). 

Summing up what has been said we can state the following rule. Let it be. 
necessary to compute the second differential d?fo of a function f at its sta- 
tionary point x? under constraints p; = 0 (j = 1, . . ., m). To this end we form 
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a 
the Lagrangian function F = /— X ^j; and compute its second differential 


n n ; 2 j=1 
Fo = Y 3 lan as). dx, dx, regarding formally dx;, . . ., dx, as indepen- 
K-A [zi 


dent ubantities: Then there holds the equality 
fy = dFo (12) 


which is fulfilled for any dx, (k = 1, ..., n) connected by the linear constraint 
equations (6). 

In this sense the investigation of d?fo can be reduced to the investigation 
of dF o. 

Let us suppose that d?Fp is a positive definite quadratic form, that is 
Fo >> O for any (mutually independent) cx, not equal to zero simultane- 
ously. If we arbitrarily choose certain values of (¥nz1, .. ., dx, not equal to 
zero simultaneously then equations (6) determine some definite values of 
dxi, <- -s dx, We thus obtain a system of differentials dx, .. ., dx, not 
vanishing simultaneously; for them we have d?Fo > 0, and therefore dh > 
= 0 as well, i.. the quadratic form dfo in the variables dxmi3,--., dx, 
(which were not written explicitly) is positive definite. Therefore fas function 
of independent variables v4.41, ..., Xn attains at x° a local unconditional 
minimum or, which is the same, / as function of xj, ..., x, attains at x? 
its local conditional minimum under constraints (1). 

We can similarly conclude that if d?Fo is a negative definite form then f has 
at x? a local conditional maximum. 

There are also more complicated cases when dF» is originally an indefinite 
quadratic form which becomes definite when the differentials dx, .. ., dx, 
are subjected to constraint equations (6). In this case it is also convenient 
to use equality (12) when this method is applied. 

The solution of the conditional extremum problem in a given domain £2 is 
carried out in accordance with the following scheme. In we find the subset 
£2, of points x at which the functions f, Ps, .. ., Pm have continuous partial 


derivatives and the matrix |= 2j has rank m. In Q, we determine the station- 


| Qx, 

ary points using the method described above. Then each of these points is 

tested for extremum. If the continuous partial derivatives of the second order 

exist at such a point then the above method of investigating the second differ- 

ential of the Lagrangian function F may prove effective. If this theory leads 

` an ambiguous case some special investigation is needed. The points 
€ Q— Q, also require a special investigation. 


Example 1. Let us determine the local conditionalextrema of the function 
S(x, y) = xy 
on the circle l described by the equation 
P(x, y) 2 2+1 = 0 (13) 
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The functions / and ¢ are doubly continuously differentiable throughout the 
xv-plane. Besides, the rank of the matrix 
lop ði 
lar i 2x. 2 
is equal to | (i.e. to the number of the constraints) throughout the xy-plane 
except at the point (0, 0) which does not belong to l. Consequently the 
points at which a local extremum is possible can only be among the stationary 
points of the problem. 
Forming the Lagrangian function F(x, y) = xy—7(x*--*— 1) of the 
problem and equating to zero its partial derivatives we obtain the equations 
OF 5 T OF _ ins, 
ax =F 24x = 0, ay = X 2^y =0 (14) 
On solving these equations together with equation (13) we obtain four 
stationary points (x, ») with coordinates x = +1 /y2 and y = x1/y2 cor- 


, 


responding to all the possible combinations of the signs “+” and “—”, 


To the point (x1, yi) with xı = yi = 1//2 there correspond the Lagrange 
multiplier 4; = 1/2 and the Lagrangian function 


F(x, y) = xy Gt yt- 0) 


The second differential of F at the point (xi, yi) is ŒF = — dx? +2dx dy— 
—dy? = — (dx— dv}. By (13), we have 2x dx+2y dy = 0 whence dy = — dx, 
and, finally, 

ËF ——(2dxy = —4dx* 


where dx is an independent differential. Consequently there is a local con- 
ditional maximum at the point (x1, y1), the corresponding maximum value of 
f being f(1/V2, 1//2) - 1/2. Using the symmetry properties of f we readily 
conclude that at the point (— 1//2, — 1/V2) there is another local condi- 
tional maximum with maximum value equal to 1/2. 

Since the circle /' is a bounded closed set and since the function f is con- 
tinuous on J’, it attains on T’ its supremum; finally, since the supremum of f 
on P is necessarily its local maximum on J’, we conclude that 


max f= (2, 1/72) = fC-My2, 1/2) = 1/2 
and, similarly, 


min f= /(/f2, -1/y2) = f(—- 1/2, My2) =-1/2 


Lemma. Let a, b!, .. ., b" be vectors in the n-dimensional space R,(m < n). 


For the representation 
m 


a= y Abi (15) 


j=l 
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where 7; are some numbers to hold it is necessary and sufficient that every 
vector c orthogonal to all bj, that is satisfying the conditions 
(c, bi) = 0 (j= h...,m) (16) 
should be orthogonal to a: 
(c, a) = 0 (17) 
Proof. Vf (15) holds then (16) implies 


Y ib!) = Y ile, b) =0 


(e, a) = (e 
j=l Jel 


and we have thus proved the necessity of the condition of the lemma. 
Let us prove the sufficiency. Without loss of generality we can assume 
that the vectors 


Dry BM (18) 


are linearly independent. Then, as is proved in linear algebra, there exist 

mutually orthogonal vectors 5"*1, .. ., b” each of which is also orthogonal to 

every vector (18) such that the vectors b', ..., b" form a basis in the si-di- 

mensional space. Suppose that, for any vector c satisfying equalities (16), 

equality (17) also holds. Ther, in particular, (a, bi) = 0 (j= m1, ..., n). 
The vector c is representable in the form of the sum 


m n 
a= Y Aj Y mb 


j=l fam+l 


n 


whence (a, 6‘) = u; = 0 (i = m4l,...,7) and consequently a = Y Zibi, 
1 


which is what we set out to prove. 


§ 7.23. Singular Points of a Curve 


As is known from the theory of implicit fenctions, if a function F(x, y) 
turns into zero at a point (xo, yo), has continuous partial derivatives in a 
neighbourhood of this point and 


or 
(2), 7 0 (1) 
then there ure 0; > O and 62 > 0 such that the set E of all points (x, y) 
belonging to the rectangle 
[x— xo] < $i, |y — ro] < 0» (2) 


and satisfying the equality F(x, y) = 0 is described by a function v = ¢(x) 
(Xo = v(xo)) having a continuous derivative in the interval (xu— 61, Xo+ ài). 


If we replace (1) in this formulation by the condition (25). +: 0 then there 
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is rectangle (2) such that the corresponding set £ is described by an equa- 
tion x = p(y) (xo = y(yo)) where y is a continuously differentiable function. 

In this section we shall be interested in the case when the function F satis- 
fies all the conditions imposed above except one of them, namely, we shall 


suppose that both partial derivatives of F vanish at the point (xo. yo): (&), = 


z ($5. =0. 


When considering the set 7' of all (x, y) points for which F = 0 we shall 
call it a curve but it should be taken into account that, under the conditions 
imposed, 7" may not be a curve in the ordinary sense. For instance, if the 
function F is identically equal to zero the set J' coincides with the whole 
xy-plane. We shall be particularly interested in the question as to what is the 
shape of I" in a sufficiently small neighbourhood of the point (xo, yo) which 
will be referred to as a singular point of the curve D. 

Without loosing generality we can assume that xo — Oand yo — 0. Weshall 
also suppose that the function F has continuous derivatives of the fourth 
order with the exception of the case AC — B? > 0 (A, B and C are defined 
below) when it is sufficient that only the second derivatives exist and are 


continuous. 
Let us denote 4 = ($4 5), B - (x. and C = (Sr) 


We shall assume that the numbers A, B and C are not equal to zero simul- 
taneously and shall consider separately the following possible cases. 

(i) 4C — B* > 0. In this case, according to the theory of unconditional 
extrema, the function F attains its (strict) local maximum or minimum at the 
point (0, 0) whence it follows that F(x, y) # 0 for the points (x, y) (x # 0, 
y = 0) belonging to a circle o of sufficiently small radius with centre at the: 
origin. 

Therefore within the circle ø the curve /' described by the equation 


F(x,y) 20: (3) 
degenerates into the single point (0, 0). ’ 
fn such a case we say that the point (0, 0) is an isolated point of I. The 
point (0, 0) itself belongs to /' but there are no other points of I" in its sufi- 
ciently small neighbourhood. 
A simple example of this kind is the equation x?+ y? = 0. 
(ii) 4C— B? < 0. By Taylor's formula, we have 


F(x, y) = Ax*+-2Bxy+Cy"+ n (x, y) (4) 
where 4t possesses the second derivatives vanishing at the origin and 
u—O(p) (= r+") (5) 


In the first approximation it is natural to replace the equation F(x, y) = 0 
by the equation Ax?-+2Bxy+Cy? = 0 which in this case (4C— B? < 0) 
represents a pair of (nonimaginary) straight lines: 


(ax Bry) (rax Bay) = 0 (6) 
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where 3 
ixi pil 
#0 7 
les f. i 
On making in (4) the substitution 
f È = xaX tby, 1) = N+ Pey (8) 
we obtain g 5 
F(x, y) = PE, 4) = ènt y(G, n) (9) 
where 
p= OP) 0? = +7?) (10) 


Here (10) follows from (5) because by (7) we have 
C10 <P « Cop 


where c, = 0 and cz > O are some constants. 

By the uniqueness of the Taylor formula expansion with the remainder in 
Peano’s form (see § 7.14), formula (10) implies that representation (9) is the 
Taylor expansion of the function ®(, 77) at the point 5 = Ņ = O with the 
remainder of order / — 3. Therefore 


3 
y(3, 9) = Y, Epl, n) 
i=0 
where y; are functions with continuous partial derivatives of the first order 
(see the end of § 7.13). 
Thus, 


3 
OE, n) = iy Y Si ip (1) 
isd 

Let us draw the two bisectors of the coordi- 

nate angles in the 57-plane (Fig. 7.10). To inves- 

tigate the part yı of the curve I” described by 

the equation ©(€, 7) = 0 which lies (within a 

sufficiently small neighbourhood of the origin) 

in the shaded region in Fig. 7.10 let us perform : 

the transformation of variables from (5, 7) to Fig. 7.10 
(3, u) of the form 





natu (ull) (12) 


To investigate the part y; of the curve J” falling outside the shaded part we 
replace ($, 7) by (u, 7) according to the formula 


i-am (lul <1) (13) 
In the first case, by virtue of (11) and (12), we have 
DE, y) = Put So, u) = 0 (14) 


where q(£, 4) has continuous partial derivatives. 
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On cancelling by 3? we obtain 
AE, #) = ut+Se(E, u) = 0 (15) 


To the point ë = 0, } = 0 there may correspond points (£, u) with £ = 
and |u| = I specified by (12). But if £ = 0 equation (15) is only satisfied 
when u = 0. The left-hand side of the equation has continuous partial 


derivatives in the vicinity of the point $ = 0, u = 0 and (=), = ]. Hence, by 


the existence theorem for implicit functions, there is a uniquely determined 
function u = u(¥) (4(0) = 0) defined in a sufficiently small interval |5| < ô, 
having a continuous derivative and SRUSDYUE equation (15), and therefore 
the corresponding function 


y= £u) (16) 


is also continuously dilferentiable in the interval | 5j < 6, possesses the deriv- 
ative (7’)o = O and satisfies the equation GE, n) = 0. This function describes 
the part y, of the curve /". The other part y; of I" which is tangent 
to the y-axis at the origin is investigated 

yj with the aid of substitution (13). 
12 Thus, in the case under consideration the 
curve I (which is the image of J” under the 
inverse transformation from £, 7 to x, y) splits 
into two portions y, and y» in the vicinity of 
* the origin which intersect at a (nonzero) angle 

(see Fig. 7.11). 
(iii) AC — B? = O. In this case we have 


Ax*--2Bxy +C)? = (ax Byy 


where x and f are not equal to zero simultaneously. Putting § = Bx—ay, 
7] = xx+ fy and arguing as above we conclude that in the new (rectangular) 
‘coordinates (5, 17) the curve in question is described by the equation 








Fig. 7.11 


: 3 
PY y Shy) = 0 (17) 


is0 


where yx) are continuously differentiable functions. The substitution 
7 = uč leads, after the cancellation by ¿°, to the equation 


as, u) = u*4-Eg(E, u) = 0 (18) 

Now we again have (0, 0) = 0 (x(0, u) # O for u = 0). If (g)o = (0, 0) # 
= 0 (this case is more general while the case (p)o = 0 is exceptional) then 
(S = = (p)o # 0. Consequently we can apply the theorem on implicit 


functions to equality (18); by this theorem, there is a uniquely determined 
function € = »(u) (»(0) = 0) possessing a continuous derivative and satis- 
fying equation (18) in a sufficiently small neighbourhood of u = 0. 
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We have 
w(u) = — u*[g(£, u), (uv) = — pw =? Hou), u)} Ig? 


Let (9)o < 0; then obviously there is ô > O such that 
v(i) > 0 for 0 <u = ô, v'(u) < 0 for —ô =u «0, v'(u) = 0 for u =0 
and the function x(u) is strictly decreasing to zero on [— ô, 0] and strictly 


increasing from zero on [0, ô]. Therefore, the function 5 = »(u) has inverse 
functions on each of these intervals. The inverse functions can be written as 


u = Xy-—5[(o)o--«(2)) (e(£) — 0, & + 0) where 5 > 0. 


We have thus obtained two smooth parts of the curve 7": 
7-tiy-sgereexP^y-(po» (§-0,0<5 <8) 


The original curve 7" corresponding to /" is shown in Fig. 7.12. 
In this case (0, 0) is spoken of as a cuspidal point of the curve f`. 





Fig. 7.12 Fig. 7.13 


The situation remains analogous in the case (~)o > 0 but the branches of 
the curve lie in the domain § < O (where the radicand is positive) in the 
vicinity of the cusp (Fig. 7.13). 

‘Of course the case (~)o = O is more complicated and requires further 
investigation. 

Note that the substitution à = um does not lead to a new branch of the 
curve because after the cancellation of (17) by n? we obtain the equation 
| 2-my (3, u) = 0 having no solution for 7 = 0 and finite u. 


8 7.24. Curves on a Surface 


Let us consider a doubly continuously differentiable surface o (or, as we 
also say, a surface continuously differentiable of order 2) specified by an 


equation 
z = f(x, y) (1) 


and a doubly differentiable smooth curve 7" lying on a which is described by 
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an equation r(s) = p(s)it p(s)j+5(s)k where s is the arc length of T' (thus 
f(x, y) and r(s) have continuous derivatives of the second order with respect 
to their arguments). 

We shall use the notation 


ez z 20 Oz , ez [rn 


"am 4a, “Hae: $m oF ae O 





(the letter s denotes the arc length of / and, simultaneously. the derivative 
ez 
x Oy 

The unit normal to the surface c at its point A (x, v, =) forming an acute 
angle with the positive direction of the z-axis is 


but we hope this will not lead to a confusion). 


zm P ga =u , l ok 


—————— ee jd ———— 
y1-pg yl-p-.4 d yipg 
The unit vector of the principal normal of /' at .4 is given by the formula 


(see § 6.11 (3)) 


y * 
v= gy = RP = RU, 
where R is the radius of curvature of /' (R > 0) and x, y, - are the compo- 
nents of r. 
Let us denote by 0 the angle between n and v. Then 








dx p y y d - 
ds? itg? ' dë k) (ë = 0) 


cos -pd'x-qd'yd 





= 3 
R ds*¥1+p?+¢" 9 


Since /' c ø the differentials of the components of r (corresponding to ds) 
satisfy the constraint relation dz = p dx-Fq dy whence 


z= pd?x--qatyA- vr dx* 2s dx dy t di? (4) 
and therefore, by (3), we havc 
cos O _ rdx +2sdxdy+ td? _ ra? +2sof -+ tji (5) 
R dsyirpigqU VT pi-g: d 
where a = a and p = ra are thecosines ofthe angles formed by the tangent 


to J" with the axes x and y respectively. 

From formula (5) it follows immediately that all the curves I C o having 
a common osculating plane L at the point A € o not coinciding with the tangent 
plane to a at A have one and the same curvature at A. Indeed, the value of the 
right-hand side of (5) at the point A is one and the same number for all such 
curves and cos Ü has one and the same value for all of them, and their curva- 
ture at A is equal to the ratio of the right-hand side of (5) to cos 0. Hence, the 
curvature of any of these curves is equal to the curvature of one of them, for 
instance, to the curvature of the curve which is the section of the surface 
o by the osculating plane L. 
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Generally speaking, this assertion fails when cos 4 = 0, i.c. when the 
osculating plane L of £ coincides with the tangent plane to «. To show this 
it is sufficient to note that two curves in a plane tangent to each other do not 
necessarily have equal radii of curvature at the point of tangency. 

Let l be a normal section of the surface o at its point .4, that is a curve 
along which ø intersects a plane passing through the normal to ø at A, and let 
I" be some other section of c by a plane passing through the tangent line to 
l'at the point A. Then the right-hand sides of (5) assume equal values at the 
point A for the curves J" and /". Besides, we have 9 = 0 or “ = = for I. 
Therefore, there holds the equality 

| cos ^ 


zr = (6) 
where Rand R’ are, respectively, ihe radii of curvature of the normal section 
and of the section having a common tangent with the former. 
Equality (6) is known as the Meusnier* formula. It can alse be rewriiten 
in the form R' = R cos 0 = R cos Ui (since R > Oand R’ = 0). 
For the normal section formula (5) gives the expression of the radius of 
curvature R: 
! 24. Isaf =- t8: 
= T (7) 
R Vipra 





More precisely, we should put the sign “--” or *—" in Iront of the lefi 
member of (7) depending on whether 0 = 0 or 6 = x. But we shall not do so 
because it is more convenient for our further aims to allow the radius of 
curvature of a normal section to assume positive or negative values (R > 0 
or R < 0) depending on whether the concavity of the normal section is in 
the direction of the positive or negative half-axis z. 

In all the considerations above including the deduction of l'ormula (7) we 
assumed that {#(s)! = 0, Le. that R is finite. Note that the notion of the prin- 
cipal normal to a curve does not make sense when F(s) = 0. But formula (7) 
continues to hold for the case #(s) = O as well. Indeed, in this case the left- 
hand side of (7) is equal to zero (R = œ) and the right-hand side also turns 
‘into zero because the right-hand side of (3) is equal to zero and, by virtue of 
(4), the right-hand sides of (5) and of (7) turn into zero together with it. 

Let us translate the origin of the rectangular coordinates to the point A 
(of the surface o) under consideration and direct the z-axis along the normal 
to c. Then p = q = 0 and x?-++/? = J, and we can put z = cos à and f = 
= sin 9. Formula (7) for the radius of curvature of a normal section is then 
brought to the form 


1 ; e T — s " 
R^ cos? 0-- 25 cos 6 sin Ü-- t sin? 0 = s + = L cos 20 — s sin 20 (8) 








The curvature 1/R is a continuous function of 0 on the closed interval 


* J. B. M. Meusnier (1754-1799), a French mathematician. 
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[0, 2z]. Therefore it attains its maximum and minimum on that interval 
which can be found by equating its derivative to zero. This results in 


tan 29 =-2- — (rer) (9) 
The function tan 20 is strictly increasing on the intervals G. A) and 
(=. X) and assumes all the values from — e» to + œ on it. Therefore on 
each of theintervals there is exactly one root of equation (9); we denote these 
roots as 9; and 2 respectively. Besides, 0,—0, = 1/2. There are two more 
Toots 0 + zz and 64+ on the period of the function but they determine the 
same sections. 

Thus, if r = £ then there are two and only two inutually perpendicular 
directions along which the curvature of the normal section attains its maxi- 
mum 1/R,and minimum 1/Rs. If the axes x and y go in these directions, equa- 
tion (8) takes the form 1/R = r cos? 0+1 sin? 0 because in this case relation 
(9) must be fulfilled for 0 = 0. 

We have !/R; = r and ]/R» = ¢ and thus obtain Euler’s* formula 

1 cos? 9 sin? 6 


RR R (10) 
The numbers R, and R: are termed the principal radii of curvature of the 
surface (at the point A). They correspond to the so-called principal normal 
sections of the surface (which are mutually perpendicular). 
By formula (10), to the section 9’ = 0--x/2 there corresponds the curva- 
ture 
]  sim6 cosh 


R^ Rm R. 





On adding together (10) and the last equality we arrive at the equality 
1 1 


i : 
R'PFTRUR 
showing that the sum of curvatures of any two mutually perpendicular normal 
sections is a constant quantity. \t is called the mean curvature of the surface at 
the point in question. 

The points of a doubly continuously differentiable surface can be classified 
in the following way. 

1. In the case RR > 0 we have a so-called elliptic point of the surface. 
For an elliptic point the radii of curvature 2; and Rə are of one sign and 
therefore R is also of the same sign for any section, that is all the normal sec- 
tions have the concavity in the direction of the positive or negative half of 
the z-axis depending on whether there is the sign “+” or “— ". For instance, 
all the points of the surface of an ellipsoid possess this property. 


* L. Euler (1707-1783), the great mathematician and physicist, a member of Si. 
Petersburg Academy of Sciences. 
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2. A hyperbolic point corresponds to the case RiR» < 0. Here the concavi- 
ties of the principal sections (and of the sections adjoining them) are in 
different directions. Thecurvature 1/R beinga continuous function of 9, there 
must exist at least two sections with zero curvature. 

There are in fact exactly two such sections; the values of 6 corresponding 





to them satisfy the relation tan 0 = +| -2; the radii of curvature of 
. . . . 1 . 

these sections are infinite. A hyperboloid of one sheet is an example of such 

a surface. 


3. In the case 





RR: = 0 (where one of the numbers R, and R: is finite) we 


have a parabolic point. Hence, in this case either Rı > 0 and 1/R: = 0, 
and then 
d _ cos 


R R, 


or 1/R, = 0 and R: <0, and then 1/R = sin? 0/ R». 

Here there is only one section, with zero curvature, all the other sections 
having curvature of one sign and concavity in one direction. An example of 
a surface whose all points are of this kind is a cylindrical surface. 

To find to what class belongs a point of a surface z = f (x, y) with tangent 
plane not necessarily parallel to the xy-plane we consider the sign of rt— s?. 
Let r > 0 and rt—5? > 0, then the quadratic form 


r dx?+2s dx dy+t dy? (11) 


is positive definite and cos 0 in formula (5) retains constant sign for all the 
values of 0; consequently the point in question is elliptic. 

If rt—5? < Othen there are two different pairs (dx, dy) for which form (12) 
changes sign; this indicates that the point is hyperbolic. If rt—s* = 0 then 
form (11) retains sign for all (dx, dy) except for one direction, and hence the 
point is parabolic. 

These considerations incidentally show that the sign of rt— s? is invariant 
with respect to all transformations of rectangular coordinates relative to 
which a small portion of the surface containing the point A can be written in 
the form z — f(x, y). This can also be shown by means of rather lengthy 
calculations connected with change of variables in partial derivatives. 

Now, let r = £; then rt—s? = r?— s? and formula (8) assumes the form 
1/R = r+s sin 20. Here we have the following possibilities. 

(i) If r2— 5? > 0 the point in question is elliptic. If s + O then, as in Case 
1 on p. 300, there are two principal sections with maximum and minimum 
radii of curvature. If s = 0 then 1/R= r = const, which means that all the 
sections have one and the same curvature; this is the so-called umbilical 
(or circular) point. 

(ii) If 7?— 5? < 0 we have a hyperbolic point. 

(iii) If r?—5? = O then the point is obviously parabolic. 

Let us consider a smooth surface S represented parametrically as 


r= xi+yj+zk = plu, oji +plu, j+ z Qu k (u v€ Q) (12 
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where Q is a domain. According to (12), to the differentials du and dv there 
correspond the differentials of the components of the vector r given by the 
expressions 
. Ox Ox ,, ...0y oy 
dx = a; dut= de, dy = 5, ^ t 5; d". lis 


oz ez 
dz = e; Itt s dv 
to which there corresponds the following expression for the square of the 
differential of arc length of a curve on the surface S: 
ds? = dx*-- dy?-- dz? = E di?--2F du dv+G dv’, (14) 
_ [ae (Ov? , (02V? 
E= (a) + (5) z (5. P 
_ Ox Ox 197 or ez ez 
= Ou Bv du de tas dv? 


c = (y) s) 


The right-hand member of (14) is a quadratic form in du and dv. For a 
smooth surface this form is positive definite since its discriminant is positive: 


2 [(DO.z D(z, x)\2 [DEIA ii Ca 2 - 
BID (e 2) Eu. » +(e n RE S "MN 











A concrete smooth curve T c S can be specified with the aid of contin- 
uously differentiable functions 


u-in)v-yu)h (42+? > 0) (16) 


If 2 and yj are substituted into (12) for u and v respectively we obtain a vec- 
tor equation of a smooth curve I lying on S for which 

dx\2 | (dyV? du du dv 

(F) - (2) +(F) =E(5 a) +i Ao) RO (17) 
for any ¢ (this is implied by the condition written in parentheses in (16) and 
by the fact that the form is positive definite). 

On multiplying the left-hand side of (17) by d? we obtain (14), that is the 
square of the differential of arc length of the curve T in question (corre- 
sponding to the differential dt). Fora given arc I" c: S the differentials du and 
dv are mutually dependent but if we are interested in the various curves 
I'CS passing through A € S their specification determines the various 
pairs of the differentials du and dv. 

Let us derive the parametric analogue of formula (5). We shall suppose 
that the surface S is not only smooth but also doubly continuously differenti- 
able. 

The left member of (5) can be rewritten as 


OOO qm 





DIFFERENTIAL CALCULUS. FUNCTIONS, ÖF SEVERA AL VARIAB LES 303 


where n is the unit normal to the surface S, r(u, v) is the radius vector of the 
moving point of the surface S and r(s) is the radius vector of the moving 
point of D. We have 
sc) — p ate, . dv 
P(S) = Fy ds Iva. 
and 
uroa (de ~ dudo. sdyy2 . dv . dw 
F(s) = Fuu 6) + 2iw = ds t hoe (=) Tuatha 
and, taking into account that the vectors £, and *, are orthogonal to n, we 
receive : 
cos 0 — Fan du^ + 2, du dv, dv?) (FX Fp) 
R ds? (Fu XÈ} 
where ds? can be replaced by expression (14). 





§ 7.25. Curvilinear Coordinates in a Neighbourhood 
of Smooth Boundary of a Domain 


Let 2 be a bounded spatial domain whose boundary is a (closed) smooth 
surface S. Let us issue a normal to S directed to the interior of 2 from each 
point A € S and mark a point A, on it at a distance of A > 0 from A. The 
collection of all the points 4, corresponding 
to a fixed 2 — 0 forms a surface S; (see 
Fig. 7.14 where are depicted the sections of 
S and S; by a plane). If A is large some 
points of S, may belong to different normals. S 
But if 4 is sufficiently small this is not the 
case. For small 2 it appears natural to expect 
that in the layer between S and S; the nor- 
mals do not intersect, and then each point 
of the layer is exactly on one normal issued i 
from a point A4 £ S. This does in fact take Fig. 7.14 -~ 
place when S is a surface continuously differ- 
entiable of order 2 (doubly continuously differentiable), that is when the 
functions representing it locally have continuous second partial derivatives. 

In the lemma below this fact is proved for the general case of dimension 7. 


= 
e 
Q 


Lemma. Let y = A(x) be a continuous operator specifying a mapping of an 
open set Qc R,on O' € R, (which may not be one-to-one in the general case). 
Suppose that there is a bounded closed subset F < Q which is mapped by A in a 
one-to-one fashion and that for each point x € F there is a neighbourhood Q; c 

c4 which undergoes a one-to-one mapping. 

For any A > 0 let us consider the set F? consisting of the points belonging to 
Q such that each of them is at a distance not greater than À from at least one 
point belonging to F. 

Then there is 49 > 0 such that F^» is mapped in a one-to-one manner under 
A: QD F^ = (Foy c Q'. 
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Proof. Suppose that the assertion of the lemma fails to hold. Let us take 
a decreasing sequence of numbers A, — 0. Then for any k there are two differ- 
ent points xy, yy € F^ such that Ax, = Ayp. The set of the points xx, y, € 
€ F^: cC FA being bounded, there is a subsequence of indices k (let us renum- 
ber them as k = 1, 2,...)such that x, + x? € F, yy — y? € F, Ax, — Ax", 
Ayk ~ Ay? and Ax? = Ay’; it follows that x? = y? since the mapping A of F 
on F' is one-to-one. But this is impossible because the point x" = y? belongs 
to the definite neighbourhood {2,0 and x4, yx € Rro for sufficiently large k, 
and, since xy = yx, there must be Ax, = Ayr- 

Let us consider an (r— 1)-dimensional manifold S (see$ 17.1) determined 
by the equations 


x; = gi(t), (u = Q5... Un-1) Eo, i-l...n) (1) 
Let us associate with each point x € S a unit vector 
V = (a), ...,2%n) (2) 
specified by the formulas 





(i—1,...,n) (3) 


where 4; are the signed minors of the elements of the first column of the de- 
terminant 














! a ep Og, 
Ou, ^ Qu,1 k ; 
d mlesccesemm en Dci di u$ ig = f zdi = y4i (4) 
" 8g, _ 99, 1 1 
" Qu Ot, 1 





The numbers 4; are not all equal to zero simultaneously since the rank of 
the matrix | E is supposed to be equal to n— 1... 

The vector v is called the unit normal vector to S at the point x € S. 
The other unit normal vector to S at x differs from v in sign. 

It is important to stress that, given equations specifying S, the vector v 
can be effectively determined. (This is a manifestation of the property that 
the manifold S is orientable.) 

Let us choose a neighbourhood of S and consider the change of variables 


xi = fau pi(uy, ..., Un—1) (u€ o, i= 1,...,n) (5) 


for its points x = (x1, ..., Xa) where ¢ is a new real variable. Functions (5) 
themselves are defined for any u € w and any real £. They are continuously 
differentiable because y; are doubly continuously differentiable. It is also 
important that for any domain w’ C à' c w there is 6 > 0 such that the set 


S? = (It <6, uc) 
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is mapped in a one-to-one way with the aid of equations (5) having a posi- 
tive Jacobian, i.e. this mapping is continuously differentiable in both direc- 
tions. This follows from the lemma proved above where the operator speci- 
fied by formulas (5) can be taken as A because it determines a continuous 
mapping of the open set Q = (— e < t < œ, u € w} of the space R, into 
R,, and under this mapping the points of the bounded closed set F = {t = 
= 0,u€ à') c Q are in a one-to-one correspondence with the points of the 
image of F; besides, for each point of F there is its neighbourhood under- 
going a one-to-one mapping by the operator A (for at each such point the 
Jacobian of transformation (5) is positive: 4 > 0). 

Let us also consider a curve I’, continuously differentiable of order 3 (i.e. 
triply continuously differentiable) and not intersecting itself, represented by 
an equation 

r = g(si--v(s)--xG)k — (0m s = so) 


(we suppose that #(¢) X (r) = 0) where s is its arc length and g, y and y are 
functions possessing continuous derivatives of the third order with respect 
to s. In this case the unit vector f of the principal normal and the unit vector 
Y of the binormal are (once) continuously differentiable functions of s (see 


$ 6.11). Let us put 
e = rtABt+ uy (6) 


where A and u are arbitrary real numbers. This equality assigns to each triple 
of numbers (s, A, p) (0 «s = So; — œ <A, u = e») the triple (£, n, £) of 
the Cartesian coordinates of vector o. Let us denote by H, (p > 0) the 
set of points of the space (s, A, u) specified by the inequalities 0 < $ = So, 
22+ p? = p?. The coordinates £, 7, ¢ of the vector o are continuously differen- 
tiable functions of s, A, p with a Jacobian D(s, 2, u) equal to 


æi fi yi 
D=|a2 B» ys|—|e(BxY) = 1 
Q3 Bs ys 


for À = u = 0 (ai, B; and y; are respectively the components of the unit 
vectors of the tangent, principal normal and binormal). The curve I not in- 
tersecting itself, equality (6) sets up a one-to-one correspondence between 
the points (s, 0, 0) (0 = s = so) forming a bounded closed set in the coordi- 
nate space (s, A, u) and the points (&, n, Č) of the curve I’. Therefore, by the 
lemma proved above, there is a sufficiently small p for which operator (6) 
maps the set H, of points (s, 2, u) onto the set 2 of points (£, n, £) in a one-to- 
one manner. By the theorem on implicit functions, the continuous differen- 
tiability of the corresponding inverse operator on the set 2 takes place for at 
least sufficiently small values of p for which D(s, A, p) > 0. 

The construction we have discussed makes it possible to introduce the 
curvilinear coordinates (s, 4, u) in a sufficiently small neighbourhood 2 of 
the curve 7' such that in the coordinates (s, A, u) the equations determining I" 
are written as A = 0, u = 0; besides, there is a one-to-one correspondence 


20006—20 
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continuously differentiable in both directions between the coordinates (s, 
A, p) and the Cartesian coordinates (£, 7, ¢) of the points belonging to 2: 


&£-—f(sAu, n=frls,A,p), = fals, 2, u) 
(on this question see also § 17.2). 


§ 7.26. Change of Variables in Partial Derivatives 


We shall limit ourselves to the case of dimension 2. In the n-dimensional 
case the calculations are quite analogous. 
(i) Let us consider a function 


z= f(x, y) (1) 
where 
x= gu, v), J= v(u, v) (2) 
: P oz , U4 az. 
We shall find the expressions of the derivatives p = er and q = yn terms 


of the derivatives of z with respect to u and v. To this end we differentiate (1) 
with respect to and v: 


Oz _ Oz Ox , Oz Oy Oz Oz Ox , Oz Oy 





du = Ge Bu ^ y Gu? 0v Ox Bvt By Ov 9) 
On solving these equations in p and q we obtain 
Diz, y) D(x, 2) 
- D(u, v) = Diu, v) 
~ Dixy)? D(x, y) (4) 
D(u, v) D(u, v) 


In these considerations we of course suppose that p and yy possess continuous 
partial derivatives with respect to u and v, the corresponding Jacobian being 
different from zero. We shall always assume that the conditions guaranteeing 
the solvability of thecorresponding equations hold and therefore this assump- 
tion will not be stipulated in what follows. 

Equalities (4) can be rewritten as 


ez. Oz Oz Oz Oz Oz 
a utaw a =o ata (5) 


where (this is important!) the coefficients A, B, C and D depend solely on u 
and v and do not depend on z. Therefore we have 


r= $e = are) =4 ar (Se) +B ae (ae) = 49 (48 +B) + 
+B (AZ +B) = AP 22 4 2AB B 
+ (4564+BS4) S (4S BS) s (6) 
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Hence, we have found the expression of the partial derivative ai in terms 
of the partial denm of z with respect to u and v. 

To compute s = x uy and t= SF we use the same procedure. Further 
derivatives are consecutively tonno. in the same manner. For instance, to 
find © EJ — we substitute A ABI for z into (6) and then perform tbe 
KE differentiations. 

(ii) Let us consider a more general problem. Let there be given equations 

F(x, y, Z, u, v, wW) 20 (j = 1, 2, 3) (7) 


connecting x, y and z with the new variables u, v and w. It is required to 
express the derivatives p, q, r, s and t in terms of the derivatives of w with 
respect to 4 and v. Since z is a function of x and y the variables u, v and w are 
also functions of x and y. 


Let us differentiate equalities (7) regarding x and y as independent vari- 
ables: 


25. ds +54 dy + 22 diy T du 4- —3 a dv4 2. dw =0 (8) 
(j =1, 2, 3) 
On solving system (8) in du, dv and dw we obtain tbe expressions 
du = Al dx+ A} dy 4- Al dz 
dv = A? dx+ A2 dy 4- A3 dz (9) 
dw = Ai dx+ 4$ dy + 4$ dz 
where A/ are coefficients dependent on x, y, 2, u, v, w. Since dw = = du4- 
+a dv, the substitution of expressions (9) for the differentials du, dv, dw 


into this equality and the solution of the resulting equation with respect to dz 
yield the equality 


dz = Mdx+N ig (10) 


where M and N depend on x, y, Z, u, v, W, =— a w and 2 $9 
Since the differentials dx and dy are ine pendent we must have 
p=M, q=N (11) 


which solves the problem in question for the first-order derivatives. 

To solve this problem for the derivatives of the second order we compute 
the second differentials of u, » and w corresponding to the independent 
differentials dx and dy. In the course of the computation there appear, to- 
gether with the differentials dx, dy, the differentials dz, du, dv and dw which 
should be expressed in terms of dx, dy with the aid of formulas (9) and (10); 


20* 
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there also appears the differential d2z, and we thus obtain 
d'y = B] dx?-- Bl dx dy+ Bl dy*+ B} d'z 
dw = B} dx?+ B3 dx dy-- Bl dy*+ Bl d'z (12) 
dw = Bj dx?+ Bj dx dy+ Bj dy?+ Bj d'z 
On the other hand, we have 


_ ow ow ow ow ðw 
dw = ET du?-+-2 = du dot ss dv Puts d?v (13) 
Finally, let us replace the differentials entering into (13) by the corre- 
sponding expressions (9) and (12) and solve the resultant equation in d?z: 


d'z = P dx*--2Q dx dy4- R dy? (14) 


It follows that r = P, s = Q and 7 = R where the right-hand members 
depend on x, y, Z, u, v, w and on the derivatives of w with respect to u and 
v of orders not higher than 2. Of course, x, y and z can be eliminated from the 
right-hand side of (13) by means of (7). 

The method we have used is based on the consecutive computation of 
differentials. It can also be applied to the first problem we dealt with (see (1), 
(2)), then we should put z = w. 


Example 1. Let us find the expression of the (two-dimensional) Lapla- 
cian* operator 


_ Ou , du 


in polar coordinates. We shall solve this problem by means of the method of 

differentials used above (it can also be solved with the aid of the technique 

used in the solution of the first problem at the beginning of this section). 
We have 


x = esin, y=ocosé (16) 


On differentiating (16) under the assumption that the variables x and y are 
independent we obtain 


dy = cos 0 do— psin 0 d0, dx = sin 0 do+ o cos 0 d0 
whence 


do = sin 0 dx+cos 8 dy, dO = (—sin 0 dy+cos 0 d) 
Further, we have 


dg = (—sin 0 dy+cos 0 dx) d0 = o dé? 


* P. S. Laplace (1749-1827), a French astronomer, mathematician and physicist. 
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and 
£o = (cos 0 dy —sin 0 dx) di — 2 (-sin 0 dy + cos 0 dx) = 
dọ dð do dô 2 do d0 
NNI UNES EMIT 


Substituting these expressions into the equality 


e oe 














" 2 Ou o 
= s 40° +2 3o 80 do dO + 5 d6? 4- $e POTS d0 
and combining similar terms imvolvings dx?, dx d id dy? we find the second 
derivatives of u and, in particular, © 3x “ and $e which leads to 
On 1 u , 1 Qu 
du = de e 3E + do (17) 


Example 2. Let us express the r Laplacian operator 
Au = EG A ae am 


in spherical coordinates. 

We have x = Q cos 0 cos p, y = p cos @ sin 9 and z = p sin 0. Let us 
introduce the auxiliary variable r = o cos 0. Then x = r cos p, y = rsing 
(z — z), and, by virtue of formula (17), we find 

aes Ot Ou , 1 Ou , Oe 


o? F ae? r Or ez 

















Now we make the substitution r = ọ cos 0,z = ọ sin 0 (y = g); by formula 
(17), this gives 











Qu , Ou eu 1 u 1 ðu 
oF tax = ag te arte De 
and, by formula (4), - 
D(z, u) 
Ou — De, 9) _ " ] ou 
=" tea = = sin 0 $5-+00s TE 
i Die, 0) 
Finally, 
u , 1 u 1 Ou 2 Ou — sin Ó Ou 
du = de? aot y "gi 00 tg cs) * cos? 0 op v e ðe o'cosÓ 80 (18) 


We have supposed that the angle 0 (the latitude) is reckoned from the 
equator of the sphere (—z/2 < 0 < z/2). The substitution 6’ = z/2—0 (0 < 
< 6' < x) introduces the latitude 0’ reckoned from the north pole of the 
sphere. In this case we have 024/06? = 02u/00’2, cos 6’ = sin 0, sin 0' = 
= cos 0 and 3u/00 = — Ou/00', which yields 

= un 1l Ou 1 Ou , 2 ðu 1 cos? Qu i 
Au=setearteant ate ie eine oy C8) 


A 





310 A COURSE OF MATHEMATICAL ANALYSIS 


Exercises 


1. Show that the curvature of a plane curve y = f(x) is expressed in 
polar coordinates (x = r cos 0, y = rsin 0) by the formula 


dr drj 
E EG a) - * dé 


T... (dy 2312 dr\ 21312 
PT [e+ Gy’ 
2. Show that the substitution E = x-Fat, n = x— at brings the differential 
equation O?u/0£0r = 0 to 0%u/Or2 = a%(O2u/Ox?). 





§ 7.27. Dependent Functions 


= f(x) = fi(xy ..., Xn) (x€G;j=1,..,m) (1) 
be a given system of m (m = n) functions of n independent variables x, ..., X, 
defined and continuously differentiable in a domain G in the n-dimensional 
space R, 


Let 


Definition. System (1) is said to be dependent in the domain G (or the func- 
tions f; are said to be dependent in G) if at least one of the functions, say, Yas 
is expressed in the domain G in terms of the other functions by means of an 


equality 
m = (yı, oa +> Ym—1) (2) 


where ® is a continuously differentiable function of yi, ..., Ym-1 that is 
relation (2) becomes an identity with respect to x = (xi, ..., Xa) in the 
domain G if we put y, = f(x) (j = 1, ..., m) in it. If case (2) holds we shall 
also say that the function Ym is dependent on the functions yi, ..., Ym—1 
in the domain G. 

If none of the functions f; is expressible in terms of the others (in G) the 
system of the given functions is said to be independent in G (or we say that 
the functions f, are independent in G). 

Theorem 1. If system (1) is dependent in the domain G, all the minors of the 
mth order of the matrix 


dh Oh 
Ox, ''' Ox, 
Vedan: (3) 
9f. Ofna 
Ox, eee dx, 


are identically equal to zero in G. 
Indeed, let for instance Ym be dependent on yi, ..., y, - 1 and expressed by 
equality (2). Then 


of, "o5 Ə . " 
Bha $» E3 (j231,...,n;inG) 


Ox; cai 
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Therefore 
9f 9f 
Ox, DX m 
m =0 (inG) 
dfa fm 
0x; Ox, 


because if we multiply the first (j— 1) rows of this determinant by, respec- 
tively, 5» (k= 1, ..., m— 1), subtract them from the mth row the resultant 
k 


row will consist of zeros. Arguing similarly we conclude that any other 
minor of the mth order of matrix (3) is also identically equal to zero in G. 


Theorem 2. Let all the minors of the mth order of matrix (3) be identically 
equal to zero in G and let s (s < m) be the greatest of the indices for which at 
least one of the minors of the sth order of matrix (3) is different from zero at a 
point x? € G. Without loss of generality we can suppose that this is the minor 


8A oh 
Ox, °°" Ox, 
poui (4) 
9f, of, 
Ox, 77 Ox, 


Then there is a neighbourhood Q cG of the point x? within which the system 
of functions fi, ..., f, is independent while the other functions fy4i, ..., Jn 
depend on fi, . . ., f, in the neighbourhood Q: 


f(x) di(fix) .... 0) (A= s+1,....m) (5) 


In other words, there exist continuously differentiable functions ®, for which 
identity (5) holds in Q. l 

Proof. By the hypothesis, determinant (4) is different from zero at the 
point x? and therefore, since it is a continuous function of the variables 
Xj, .++5 Xn it is also different from zero in a neighbourhood Q; of this point; 
consequently the system fi, ..., fs is independent in the domain Q, and in 
any neighbourhood w 3 x° of the point x? contained in Q; (œ c Qı) (see 
Theorem 1). . 

Further, since determinant (4) is different from zero in Qı, the system 


yj—fiQn - -<s Xss Netty <- -3 Xn) = O (j= 1,...,5) (6) 
is solvable with respect to (x1, ..., Xs), more precisely, there is a rectangle 


A= {Ixa il so, ..., [Xs— x8] 0, xsi X943] = 6, ... 


t5 |x«— Xa = à, Iy1— yil = Ô, t3 [ys— x zm ô} 
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and there exist (uniquely determined) continuously differentiable functions 
Xj 2 (Needs s Xn Yh Js) (21.5,...5) (7) 
defined on the projection 
A’ = (xui xpa] << Â, «2.5 lx 38] m 6, 
y1i-»3 «8, ..., lys—y8] = 9) (8) 
of the rectangle A which turn equalities (6) into identities with respect to 
(Xs435 +--+» Xm Pis - - -s Ys), that is 
yi— fi (us -- -s Hss Xenia Xa) = 0 (J=1,...,58) (9) 
so that |uy—x]| «c (j= 1, ..., s) and the rectangle 
4" = {xi xi] <a, ...,|xs—X8| 90, XS Xil < 4, LL, | xa al 5 9) 
belongs to 2;. Moreover, if a point (x1, ..., X» Yis ---> Ys) € A satisfies 
system (6) its coordinates must be connected by equalities (7) (the last 


property expresses the uniqueness). 
For our aims it is convenient to introduce the vectors 


@ = (25... 25,2) — eam b - (S. iss #1) 


Ox, °°"? Ox,” Ox, ! 0x, 





where k > s is a natural number. 
On differentiating (9) with respect to xy we get 


=$ OG 9m | Oh G=1,...,5) (10) 


$x Oxy Tan 


The substitution of y; into f; (A = s+1, ..., n) results in the functions 

fpa, in» Hss Xsglo - ve Xu) (11) 

which a priori depend ON Xs41s <-s Xn Yi +++ Ys But in fact they only 

depend on yi, ..., Ys- Let us prove this property. The total partial derivatives 
of these functions with.respect to x are.equal to the expressions 

ab = Y Oh Om , Of (12) 


i21 Ox; 0x, "exi 


By the hypothesis, we have 
Bh — 8A dA 
Ox, "°° Ox, Ox, 
94 — 95 95|20 
Ox, "7 Ox, Ox, 
oh, of 0f 


Ox, “°" Ox, Ox, 
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while the minor of the sth order of this determinant occupying the upper 
left corner is different from zero in Zl" c Q,. Thus, the vector a is rep- 
resentable as a linear combination of the vectors a, ..., a. By (10), the 
latter vectors are orthogonal to 5, and hence the vector a® is also orthogonal 
to b. This means that expression (12) is identically equal to zero in 4’. We 
have thus shown that the total derivatives of functions (11) with respect to 
xk (k = s+, ..., n) are identically equal to zero in A’ for 4 > s. Therefore 
these functions do not in fact depend on x,41, ..., x,. Consequently 


fias - -s Hss Xen » - -s Xn) = Xy, ...Y;) (4 = s+), ..., n) (13) 


where Ø, are continuously differentiable functions of yı, ..., Ys. Now, 
using the continuity of the functions f(x) for the indicated values of ô and 
c, we find 6, > 0 (6; < ô, 01 = o) such that for the values of x; satisfying 
the conditions 


Ixj-x = ô (61 < 6,6, < o) (14) 
there hold the inequalities 
1x) (91-9 (j=1,...,5) (15) 


Then for the points x = (x1, ..., Xa) belonging to cube (14), which we shall 
denote Q, we have the relations (see the explanations below) 
fis o- -s Xn) = Salty s.s Hss Needs e Xn) = 

= Oy, eJ) = o. fi(x), UE f(x) (16) 

which means that y; (4 = s+1, ..., n) are dependent on yy, ..., y, in Q. 

For x = (xi, ..., Xn) € Q the points (x.41, ..., Xy, Yis -- +» Ys) belong to 

A’ (y; = f(x); see (8)) and therefore 
xj = pix, -> Xm Jh aus) (21, sret) 
which proves the first equality (16); the second equality (16) follows from 


(13) and the derivation of the third one reduces to the reverse replacement of 
y; by Hx). 


CHAPTER 8 


Indefinite Integral. 
Properties of Polynomials 


§ 8.1. Introduction. Integration by Change of Variables 
and Integration by Parts 


In § 1.6 weintroduced the notions of the antiderivative and of the indefinite 
integral. The reader should recall this material before proceeding to the study 
of the present chapter. The aim of this chapter is to provide practical 
means for the computation of indefinite integrals of some clementary 
functions. 

In the theory of the definite integral (Chapter 9) we shall prove a theorem 
asserting that every function f(x) continuous in an open interval (a, b) (or in 
a closed interval [a, b]) possesses an antiderivative F(x) defined on that inter- 
val which is also continuous. Since by the indefinite integral of f on (a, b) is 
meant the general expression for the family of all the antiderivatives of f, 
and since any two antiderivatives of f only differ by a constant summand, 


the indefinite integral of f on (a, b) is written as f f(x) dx = F(x)+C where 


F(x) is an arbitrary concrete antiderivative of fand C is an arbitrary constant 
which should be appropriately chosen to obtain a definite antiderivative. 
On the basis of the theorem we have mentioned we can say that every func- 
tion f continuous on an interval has the indefinite integral on that interval. 
But it turns out that an antiderivative F of a given elementary function f (see 
$ 1.3) is itself by far not always an elementary function. For some elementary 
functions their antiderivatives are also elementary functions but in the gene- 
ral case this is not so. Here lies an essential difference between the differential 
calculus and the integral calculus: the derivative of an elementary function is 
always an elementary function while the indefinite integral of an elementary 
function may not be an elementary function. In other words, there exist 
elementary functions which, as we say, are nonintegrable in elementary 
functions. Their indefinite integrals exist but cannot be represented in terms 
of elementary functions. 

Fortunately, there are some rather wide classes of elementary functions 
important for practical applications of mathematics whose indefinite integ- 
rals are expressible in terms of elementary functions, that is their antideriva- 
tives are elementary functions. 

This chapter is devoted to the study of the integration methods for func- 
tions belonging to such classes. 


34 
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To begin with we present the table of indefinite integrals implied by the 
basic table of the derivatives of the simplest elementary functions: 





nt 
[e = aa +C (n+1 = 0) 
IET = In |x|+C 
x 
jee- e*4-C 
a 
[v4 = ;5+C (0-0 


fes x dx = sin x--C 
J sin x dx =—cos xc 
J sec? x dx = tanx+C. 


[oe x dx =—cotx+C 





Í dx _ arc sin x+C = —arc cos x+C’ (c = $+C) 
yi-x 2 


dx _ 
[3 = arc tanx+C 
f cosh x dx = sinh x+C 
f sinh x dx = cosh x+C 


On the left-hand side of each of these equalities stands an arbitrary (but 
definitely chosen) antiderivative of the corresponding integrand function 
while on the right-hand side there is a concrete antiderivative to which a 
constant C (we call it an arbitrary constant or a constant of integration) is 

added such that the equality between these antiderivatives holds. 

The antiderivatives entering into these formulas are defined and continuous 
in the intervals where the corresponding integrands are defined and contin- 
uous. This is due to the fact mentioned above: every function continuous 
in an interval has a continuous antiderivative in that interval. 

In $ 1.6 we deduced the formula 


f (A(x) + Asv(x)) dx = A f u(x) dx+ Aa | v(x) dx c (1) 


expressing the /inear property of the indefinite integral. 
One of the most important methods of the integral calculus is integration 
by change of variable (by substitution): 


[A de = [ SPO) eO are = | (EH) d+ (2) 
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In this formula it is supposed that x = g(f) is a continuously differentiable 
function (i.e. having a continuous derivative) in an interval of variation of t 
and f(x) is a continuous function in the corresponding interval of the x-axis. 
The first equality (2) asserts that its left-hand side is identically equal to the 
right-hand side in which, after the integration has been performed, the sub- 
stitution x = g(t) is made and the constant C is appropriately chosen. Let us 
prove what has been said. 

On the left-hand side of (2) stands a function which is an antiderivative of 
I(x). If x is replaced by x = gf) in this antiderivative, then its derivative 
with respect to Z is 


A [fen dx = (ff ax) oO —.fto)o'o 


Consequently, if we make the substitution x = g(/) in the antiderivative of 
f(x) the resultant expression is an antiderivative of f (p(t) p(t). As to the 
integral on the right-hand side of (2), it gives, by definition, the general ex- 
pression for an arbitrary antiderivative of f(g(/))g'(r). As we know, two 
antiderivatives of one and the same function only differ from each other by a 
constant C. This very fact is expressed by the first equality (2). The second 
equality (2) is of a purely formal character: we simply agree to write 


J FOr Od = | FO dpt) (3) 
For instance, 
: 1 
fex dx = ze dx+C = zl e* d?) C = 
= Z ferdutcy = lec, = Lec. (u— x?) (4) 


The first equality in (4) is written in accordance with (1), the second is 
written by virtue of (3), the third equality corresponds to (2) (the constant 
has been changed here) and the fourth one is written by virtue of the tabular 
formula (where the constant has been changed again). In practical computa- 
tions we usually do not write the arbitrary constant C in the intermediate 
expressions involving indefinite integrals; for instance, the above calculations 
(4) can be written in the simplified form 


je xdx = y[eds = [etae - enec 


where the obvious third and fourth equalities are omitted. 
Here are another two examples of this kind: 


f eax ==] aan = ee 


f sin kx dx = al sin kx d(kx) = —4 cos kx+C 
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We also give some more examples which will be of use for the theory of 
integration of rational fractions: 


f dx _ f dx-a) _ 1 
(x-aP* — ha ar — (x-ay-!(1—m) 


= = fe ao 








+C (m z 1) 


= In |x-al+c 


= ud dixjla .— 1 x 
Kex 77a] Tray Coa S tan aTe 


E 
lee ae os 





1 
-x) dx = 5- (In |x—a|—In |x+a))+C = 


x-a 
x+a 


In +C 











f dx =Í zs | A(xt(pl2)) _ 
x+px+q TOD (x+ 
p z 
-mgmt 7-9) © 


[2E lemom - | orum. — 
S+px+g (x-- GI2)Y-- (a— (p?/4)) (xomyra c 
d (em 


E 1 a d x (p]2) 
=- meca dx = — arc tan o +C 
a 


^ 


(a- 4 -g o, a > 0) (6) 








dxf _d(xt+(pi2))_ _ 9 , Ixt(pl2-a 
Poorer, ,n f (x-(Q/2)y—à ~ 2a ! | xx(ip/2*a +C 


l-5 =~—@, a> o) (7) 





(2x+pjdx _ f d(x*+pxt+q) — 2 
apera T) arpaga T le PX td] +C 
_Ax+B_ =4/ See PET RIAN Jy 4 [ erp ax 1. 2 [gu dix 
aper] A x’+px+q =O J t4pxtq +7 wi+pxt+q 


=á Eon (440, D=4 + (GP -p)) (8) 


EET 
(further computations of the last integral reduce to (n) 

For the theory of integration of rational fractions it is important that the 
computation of integrals (5)-(8) in which a, A, B, p and g are constants leads 
to elementary functions (namely, to rational functions, logarithmic functions 
and to the arc tangent). 
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Now we proceed to the formula of integration by parts: 


fw dx = w- | vu' dx+C (9) 


$ 
or, equivalently, f udv = uv— Í vdu+C. 


In this formula u and v are continuously differentiable functions. The deri- 
vative of the left-hand side of the formula i is equal to wv’ and the derivative of 
the right-hand side is also equal to uv’ = (uv)'—vu'; therefore they only 
differ by a constant, which is expressed by (9). 

Consider the following examples: 


fin xdx =x In x- | dx = x(In x—1)+C 
[se = f xde = ex- [e dx = e(x—1)+C 


[xsinxdx = f xd(—cos x) = —xcos x+ f cos x dx = 
=—xcosx+sinx+C 


je cos x dx — e«* sin x-a [e sin x dx — 
,— e% sin x—a [e*(—cos xa [e cos x dx] 


whence 


&*(sin x+a cos x) 


rE +C 


J e** cos x dx = 

We also present one more example which will be of use in the theory of 
integration of rational fractions. 

Let k > 1 bea natural number and a => 0 an arbitrary real number. Then 


dx 1 x2xdx 


= @ | Grats | Gray = 


= 08 fau ze TJ area] 
whence 


3-2k dx 


rta 2(1—k) J (+a) 


a? J NL. A = at EP 
E+E Uk 1) Gr a^ 
Now, if k — 2, the integral on the right-hand side admits of the application 
of the same technique, which reduces by unity the exponent in the power 
function entering as the denominator in the integrand fraction. Proceeding 
in this way we ultimately arrive at an integral of (x?+ a?)—1 which is reducible 
to the arc tangent. 


INDEFINITE INTEGRAL. PROPERTIES OF POLYNOMIALS 319 


Thus, for rd = a? > 0 and any natural k the integral 


FEM Ln | Sau 
| cm [utm (s x+4) (10) 


is expressible in terms of elementary functions. 
Examples 


Change of Variable (Substitution) : 


d. 
]. f IF = (arc tan x-tarc tan 1)+C = arctan xtlic 











lex 
lyr FS = arsin g +c (a > 0) 
later Kuna — In |tan x|4+C 
e = nic 
5. [n xdx = -Í desn —]n |cos x|+C 
6. [oe = Tas m z fse 5 4(3) == tan 37€ 
klaer lze 7 ] irre = 


= 23 arc tan (zz tan x) +C 


y2 y2 
Integration by Parts: 


8. farc sin x dx = x arc sin x- [ gar xarcsin x-Y1—x? +C 
—X 








xdx |... 1 —xare sin x [dx 


yi-x m 


9. _faresin x 
= x—y1— x? arc sin*x +C 
10. [zs e = xtanx-— | tan xdx = x tan x—In |cosX| +C 


Combined Methods: 
11. J tan? x dx = [ (sec x—1) dx = tan x-x4-C 


1+x 
12. f TE dx = 








a = (1+ x) arc sin x — f arc sin xdx= 
—x* 


arc sin x -y1— x?--C 
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§ 8.2. Complex Numbers 


Complex numbers can be defined formally as pairs (x, f) of real numbers 
(« and f) for which the equality relation and the arithmetical operations are 
defined according to the following rules: 


(i) equality («, 8) = (x1, £1) takes place if and only if = zı and f = f; 
(ii) (a, B) x (uw, Bi) = (ai, PBI) 
(a, B) (xi, p) m (xz1— Bf, xpi oif) 
(a, B) = (zum AES) 
(41,61) aiti C — cb 
For the pairs of the form (a, 0) (and only for them!) the notion expressed 
by the symbol “ < " is introduced: 


(x,0) -(8,0, if z-«p (1) 


There holds the obvious one-to-one correspondence « ~ (a, 0) between 
the pairs («, 0) and the real numbers «. It is important that this correspon- 
dence is isomorphic with respect to the arithmetical operations and with 
respect to the symbol “ < ^: 


xi (x,O0)- («, 0)X(B, 0) 
xB ds (xB, 0) = (x, 0) (B. 0) 
$($ 9-59 69 


8 B ~~ (6.0) 
(also see (1)). 

This shows that the pairs (a, 0) are real numbers (more precisely, they can 
be identified with real numbers). Hence, the symbols (a, 0) can be regarded as 
representing the real numbers and therefore we shall simply write « = (a, 0). 

Thus, the set of all pairs contains as its subset the set of all real numbers. 
As to the pairs (x, 8) with 8 = 0, they are not real numbers and represent 
new objects which we call complex numbers. 

It can readily be checked that the pairs satisfy the axioms of arithmetical 
operations similar to the axioms of real numbers (see 8 2.4, Axioms II, IIT) 
‘with the exception of those involving the symbol * < " which thus should be: 
excluded. (The pairs (a, 0) satisfy, of course, all the axioms of real numbers.) 

The pairs («, 0) have already been denoted as x. For the pair (0, 1) we in- 
troduce the symbol i : i — (0, 1). 

We can perform the arithmetical operations on the real numbers « and on 
the symbol i since they are pairs of real numbers for which these operations 
have already been defined. These operations result in new pairs which can be 
written as some arithmetical combinations of real numbers «, B, ... and the 
symbol i. The calculations are simplified if we take into account the relations 
i? = ii = (0, 1)(0, 1) = (-1, 0) =—1. 

Every pair can be presented as an arithmetical combination of real num- 
bers and the number i: 


(a, B) = (a, 0)+(0, B) = « +800, 1) = «4- iB (2) 
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Thus, there is a one-to-one correspondence between the pairs («, f) and the 
expressions c--if specified by equality (2). This correspondence is an 
isomorphism relative to the arithmetical operations because by virtue of the 
arithmetical rules for real numbers and for the symbol i we have 


(&.4- iB) E (ei iB) = («xo1)-- (B 1) 
(«-- iB) (o - iB1) = (a&1—BB1)-- i(xBi-- oif) 


ERE mur CAO 





Now we can discard the symbols («, B) and operate only with the expres- 
sions (complex numbers) «+78 representing the pairs. A further step is to 
denote a complex number œ + ifj, where « and B are real numbers, by a single 
letter, for instance, to write a = a+if; in this no- 
tation x is called the real part of the complex num- y 
ber a and f is called the imaginary part of a (the 
number f itself is of course real). 

When saying that we are given a complex num- 
ber a =a+i8 we mean, without further stipula- 
tions, that « and f are real numbers. 

The complex numbers can be represented geo- 
metrically as points of the so-called complex plane Fig. 8.1 
(see Fig. 8.1). In this construction with each com- 
plex number a = «-+i8 is associated a point (the point a) with rectangular 
coordinates œ and f in the complex plane. The x-axis (Fig. 8.1) along which 
x is reckoned is called the real axis (or the axis of reals) and the y-axis along 
which P is reckoned is the imaginary axis (the axis of imaginaries). Denoting 
by o the length of the radius vector of the point a and by @ (for a 0) the 
angle (expressed in radians) formed by the radius vector with the positive 
half-axis x we clearly have x = pcos 0, f = ọsin Ó and g = Yo2+f? = 0 
and consequently 


i 
| 
| 





a — &4-iB = o(cos 04- sin 0) (3) 


If a = 0 then g = O and equality (3) continues to hold for any 8. 

Thus, we have shown that every complex number a is representable in 
form (3) where p is a nonnegative number. In this trigonometric form of 
complex numbers o is a uniquely determined (nonnegative) number for a 
given complex number a; generally speaking, 0 is not determined uniquely 
for a given complex number but if we additionally impose the requirement 
that it should satisfy the inequalities 


0 «0 <2x (4) 


then, for a # 0, it becomes unique. If, under condition (4), o or Ô (or both) 
is changed in (3), the original complex point goes to another point distinct 
from the former. 


20006 —21 
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The number p is called the modulus (also the absolute value) of a and is 
denoted |a| = o = Va?4-?. If a is a real number then its modulus coincides 
with its ordinary absolute value. 

The number 9 is called the argument of a and is denoted Arg a. If a given 
value of 0 satisfies equation (3) then any other value differing from the 
former by 2kz (k= 0, +1, .. .) also satisfies it. For a given complex number 
a the corresponding (uniquely determined) value of 0 satisfying (3) and the 
inequalities 0 « 0 — 2z is termed the principal value of the argument of a 
and is denoted arg a”. It is clear that 


0 = Arg a = arg a+2kx (k =0, £1, +2, ...) (5) 


and that Arg a is an infinite-valued function of a, the value arg a specifying 
a single-valued branch of this function. Any solution 0 of equation (3) can 
be written in form (5). 

Let us put (at present purely formally!) 





e? = cos + isinÜ — (— œ< 0 <œ) 


This relation can be regarded as a definition of the function e7 for the pure 
imaginary argument z = ið. For an arbitrary complex variable z = x4-iy 
the function e7 can now be defined by means of the equality 


e = ee = e*(cos y-- i sin y) (6) 


The expression e? is a complex function (assuming complex values) of 
the real argument 0. When 6 varies continuously in the half-interval 0 = 0 < 
< 2x the point e? in the complex plane describes continuously a circle of 


radius 1 with centre at 0. Thus, |e?| = cos? 0-rsin?Ó = 1.. It is 
evident that e? is a periodic function with period 27: e6*?5 = e”, [t 
possesses the properties 


gio 91) — gid gio, (7) 
and 


which hold for any values 0 and 0, since we have 

e? ef = (cos 0-r i sin 0) (cos 0:+i sin 01) = (cos 0 cos 0,—sin 0 sin 01)4- 
+i(cos 0 sin 0,-- sin 0, cos 0) = cos (0--01)-- i sin (0--0,) = ee*o) 

and 


1 1 = fll n 
0 = cosOtisinod COS 0—isin ð =e 
* Jt may sometimes be convenient to define the principal value of the argument of a as 
the number @ satisfying (3) and specified by an inequality of the form a = 0 < a+ 27 
Or @y < 0 = æ+ 27% where &, is an arbitrary number. 
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: o : 
It also follows from (7) that e@-% = e?e- = P . What was said above 
elo 


implies that every complex number a is representable’? in the exponential 
form a = oe? where p =O is a uniquely determined number equal to |a| 
and 8 = Arg a is determined to within a sum- 
mand of the form 2kz (k = 0, +1,. 

For any complex numbers a and b there holds 
the inequality 


|a+b| « |al+|d| (8) 
and another inequality 
lal — lbi sla—5| (9) 


implied by the former. They express the geometri- 
cal fact that (see Fig. 8.2) the length of a side of a 
triangle does not exceed the sum of the lengths of Fig. 8.2 

the other two sides and is not less than their differ- 

ence. Inequality (8) can be rewritten in terms of the real and imaginary parts 
of a and b, namely it reduces to the inequality (see 8 6.2 (9)) 


Vata) + (B - B1! e Yo -- P+ Y ot - Bt 


There also hold the relations 

















lab] = |a||b] (10) 
and 
Arg (ab) = Arg a+ Arg b--2kz (11) 
which imply 
a a 
Tis" bzo (12) 
and 
Arg = = Arga—Argb+2ki — (k = 0, +1, ...) (13) 


Equality (11) should be understood in the sense that if some admissible 
numbers Ü;, 0» and @ are chosen as arguments of a, b and ab, respectively, 
then 0 differs from 0,--0» by a summand 2kz where k is an integer. The 
meaning of (13) is analogous. 

Let us prove (10) and (11). Let a = ge, b = pe: and ab = pe? 
where 6), 0; and 0 are some definite (but arbitrarily chosen) values of the 
arguments of a, b and ab respectively. Then 


oe = pipe 600 

and, by the obvious properties of the exponential representation of a com- 
plex number, there must be 9 = 010» and 9 = 041--05--2kz where k is an 
integer. 


21* 
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Given a complex number a = «+f, the number à = «— if is called its 
conjugate (complex) number. If a = & is a real number then @ = a. 
We obviously have 


a&b-aib ab =æ, (F) =F (b 0) (14 


because if a = «1+i81 = pe" and b = ae+ife = ore: then 


atb = (citas) (P1 Bs)i = (x1 te2)—(Pitfe)i = 
= (%1— Ari) +(%2— Bal) = a 
and 
ab = p102e'0 +42) = 9192e-"%+%) — ge poe: = ab 


Let us consider the problem of computing the nth root of a complex 
number a = ge%(g > 0). It is required to find all the numbers b = reir 
such that b" = a. For such b’s we have r'e’? = ge? (r, o = 0), and, by the 
properties of representation of a complex number in the exponential form, 
we obtain ọ = r? and np = 04-2kz, k = 0, +1, ... From the first of these 


n... 
equalities it follows that r = Vo > 0 (r is the arithmetic nth root gr the 
2kx 


positive number g). The second of these equalities shows that y =< — 
(k = 0, +1, ...). 

The values of p which yield essentially different values of the nth root of a 
only correspond to n successive values of k, for instance, 


pi = 42E (k 20,1,...,n—1) (15) 


To the other integers k there correspond the values of differing from one 
of the values (15) by an integer miltip of 2x which do not give new values 
of the root. 

We have shown that there are exactly n different values of the nth root of a 
complex number a ~ 0 expressed by the formula 


"n T n. 
Va = yoe = Yo ee — (k—0,1,...,n—1) 
where pẹ are given by equalities (15). 





Examples 
. 2ntl 
1 sn 2 x 

1. ++cos x+cos 2x+...+cosnx = r a(x) (16) 

2 sin — 

2 

cos $—cos (1+ 5) x 

2. sinx+...+sin nx = —————————— (17) 


2 sin Š 
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If we equate the real and imaginary parts on both sides of the equality 


n gikx t: chat Dz_. elt = ent 0/2» eizh = 


A er eG e~a 70 
— sin (n- (0/2) x _ 1 , ; cos (x/2)—cos (n+ (1/2) x 
~ — 2sin (x/2) 2 2 sin (x/2) 

we directly obtain (16) and (17). Sums (16) and (17) play an important role 

in the theory of Fourier's series; functions (16) are termed Dirichlet's sums 

or Dirichlet’s kernels. 


8 8.3. Limit of a Sequence of Complex Numbers. 
Function of a Complex Variable 


The limit lim z, of a sequence of complex numbers Zn = @n+ i, (n = 
= 1,2, ...) is defined as a (complex) number zo = «o+ iĝo for which 
ae 
|2n—Zo| = V(%n—%0)*+(Bu— Bo)? +0 — (1 +) (1) 


or, which is obviously the same, as a number zo = o%9+ ifo for which a, — «o 
and Bn > Bo (n— œ) simultaneously. If Zo is the limit of z, we write lim z, = 
= Zo OT Z, > Zo. ao 

Since the existence of the limit of z, reduces to the existence of the limits 
of its real and imaginary parts we readily conclude that, as in the case of 
real sequences, Cauchy’s criterion holds for complex sequences: for a se- 
quence {z,} to have a limit it is necessary and sufficient that, given any 
€ > 0, there should exist N such that for all n, n' > N the inequality 
|Z,—Zn'| = £ takes place. 

It can also be easily shown that the existence of limit (1) implies that | z,]— 
+ |zo| (t + œ). 

There also hold the equalities 


lim (z,+z;,) = lim z,+lim z, 








lim (z,z;) = lim z, lim z (2) 
- 2, _ lim z, aree SP 
lim s ^ imz (lim z, ~ 0) 


where, as usual, the existence of the limits on the left-band sides of the 
equalities is asserted as a consequence of the existence of the limits of z, 
and Zp 

Let G be a set of complex numbers z = x-- iy (which can be equivalently 
interpreted as a set of points in the complex plane). If there is a law according 
to which to every z € G there corresponds a number w (which is complex in 
the general case) we say that zhere is a function w — f(z) of the complex 
variable z defined on G. 

By analogy with a function of a real variable, the notions of the limit, 
continuity and derivative are defined for such a complex function. 
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By a neighbourhood of zo is meant a set of points z (in the complex plane) 
for which the inequality 
|z—Zo| = ô (3) 


holds where ô is an arbitrary positive number. 

A (complex) number 4 is said to be zhe limit of the function f at the point z 
if fis defined in a neighbourhood of the point zo except possibly at that point 
itself and if for any € > O there is ô > 0 such that |f(z)— A| < for all z 
satisfying the inequality 0 < |z—zo| < ô. 

If A is the limit of f(z) at ay we write 

Im Ji) e or f(z)- A, Z= Zo 

This dinno is A O to the following: for any sequence {z,}, 
Zn Æ Zo, convergent to zo the relation lim /(z,) = A holds. 

The following properties of limits hold: 


jim {u(z)+0(z)} = lim u(z)+ lim v(z) 


lim {u(z) v(z)) = lim u(z) lim v(z) 
z= Zo Z—2Z9 z= Io (4) 
ulz) lim u(2) 
: Z Eins] . 
Jm 6) wz) lim w(z (ie. (2) = 9 


Ike 


Their proof is completely analogous to the case of real functions of a real 
variable (see § 4.1, Theorem 6). 

We say that a function f is continuous at a point z? if it is defined in a neigh- 
bourhood of z? including the point z^ itself and if lim f(z) = (2°). 


z+ Zo 
It follows of course from (4) that the sum, the difference, the product and 
the quotient of functions continuous at z° are continuous functions at z? 
(in the case of the quotient the usual stipulation that the divisor is. different 
from zero should be made). 
The derivative f'(zo) of a function f at a point zo is defined as 


lim Liat Ae Sea) = f'(zo) (5) 
420 z 
The kth derivative of f at a point z is defined by induction: 
S2) = (FEM (k= 2,3, ...) (6) 


The relations below are proved like in the case of real functions: 
[u(z) X e(z)' = wu'(z) x: e'(z) 


[u(z) v(z)' = u(z) v'(z)+-u'(z) w(z) (n 
(AB) = OLOO (v) #0) 


((—ayy =n(z—ay"?  (n=0, £1, £2, ...) (8) 
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In this chapter we shall also deal with complex (complex-valued) functions 


of a real variable 

I(x) = eG) iy(x) (9) 
(where 9 and y are real functions defined on a set of real numbers x). The 
function e = cos 8-Fisin 0 (— œ- 0 <æ) is an example of such a 
function. The notions of the derivative and of the indefinite integral are 
introduced for such functions in a natural manner: 


f'(3) = 9'(o)- iy (x)j (10) 


[Sd = f g(x) dx+i [ v) dec an 


(where C is a complex arbitrary constant). 
From (11) follows the equality 


f (AOBA) dx = A | Nxdx+B [fo dec (13 


where A and B are complex constants and f; and f» continuous complex 
functions. 


Remark. Let a function f(z) be defined in an open set G of points z of the 
complex plane. Suppose that G intersects the real axis x along an interval 
(a, b) (Fig. 8.3). Then f can also be regarded 
asa (generally speaking, complex) function 
f(x) of the real variable x € (a, b). If f has the 
derivative at a point x € (a, b) in the sense of o b 
the definition stated for complex functions of x 
a complex argument, that is if there is the 
limit lim. LEAO — f'(x) when Az 

Az—-0 

tends to zero running through any complex Fig. 8.3 

values then, moreover, the function f has the 

derivative f'(x) (equal to the former) at the point x in the sense of 
the definition stated for functions of a real variable which requires 
that the limit lim LR = f'(x) should exist as 4x tends to zero 

dm eds cd 2 

only running through any real values. The converse does not hold; this 
can be confirmed by the example of the function |z|: its derivative in the sense 
of a real variable exists at any point x > 0 and is equal to 1 while its deriva- 
tive at the same point in the sense of a complex variable does not exist 


and 


because the ratio cl (in which 4z = oe!) has no definite limit as 
e [4z| — 0: 
|x--dz|-ix| _ V(xtecos 8f-r(osin Fx _ Vx*--2xocos0-ro—x .. 

Az ~ 00 ge a 


(2xe cos 6+ o°) z +o) 
amon qng o =a ee " e--0 (13) 
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where the limit lim cost has no definite value. The limit in (13) exists when 
0—0 





Az — 0 so that the corresponding point in the complex plane moves toward 
the origin along a ray passing through the origin but, generally, the value of 
the limit is different for different rays. In the third equality (13) we have taken 


x outside the root and then used the equality Y1--u — 1-ru/2-- o(u), u — 


> 


§ 8.4. Polynomials 


In § 5.9 we dealt with polynomials of the nth degree 
O,(x) = aecaixd-...-asx" — (a, = 0) 


where the coefficients a, and the variable x were considered real. In parti- 
cular, we derived Taylor's formula 


n (h) 
Q.(x) = X Qi te) (x— xo)* 
k=0 
in which the derivatives were interpreted in the sense of a real variable. 
In the present section we shall consider more general polynomials of the 
nth degree 


Q,(Z) = do+@iz+ . . - + anz” (an = 0) (1) 


where ax are, generally, complex coefficients and z = x+iy is a variable 
assuming any complex values. 

If we substitute (z—zo)--zo for z into the right-hand side of (1) and com- 
bine similar terms with equal powers of (z—zo) the polynomial Q(z) is 
brought to the form of a sum involving powers of (z— zo): 


Q(z) = bot+-by(z—Zo)+ .. . + ba(z— zo)" (2) 
The derivative of the kth order of Q(z) (understood in the sense of a comp- 


| ex variable, see the foregoingsection) is equal to Q(z) = k!by+(k+1)... 
... 2(z—zo)+ .... Therefore Cue 


(k), 
br = See) (3) 
and 
QG) = Y 2589 E-z) (4) 
0 


We have thus derived Taylor's representation in powers of (z— zo) for the 
given complex polynomial Q(z). It implies that Q(z) has a unique expansion 
of type (2): if two polynomials are equal to each other identically (i.e. for all 
z) their coefficients in like powers of (Z— zo) are also equal because they are 
defined by the same formulas (3). In particular, the coefficients of a polyno- 
mial of the nth degree identically equal to zero are all equal to zero. 
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If zo is a point such that 


QGo) = O'(zo)= ... = Q-9(z)) = 0, QOZ) = 0 (5) 
the polynomial Q(z) can be represented in the form 
Q(z) = (z-zo)* R(z)  (R(zo # 0) (6) 


where R is a polynomial of degree n— k. Conversely, (6) implies (5). Indeed, 
by Taylor's formula (4), formula (6) follows from (5) and, on the other hand, 
if 6 holds then we can multiply all the terms of the expansion of R(z) in 
powers of (z—Zo) by (z— zo)* and add them together, which results, by virtue 
of the uniqueness, in Taylor's expansion of Q in powers of (z — zo) satisfying 
conditions (5). 

If (5) or, which is the same, (6) takes place we say that zo is a root of multi- 
plicity k (or a k-fold root) of the polynomial Q. We can also say that zo is a 
k-fold root of Q if Q(z) is divisible by (z — zo)" and not divisible by (z—zo)**?. 

The well-known fundamental theorem of algebra asserts that any polyno- 
mial Q of degree n > 0 has at least one complex root. 

As readily follows from this theorem, a polynomial of degree n has in fact 
exactly n roots counting their multiplicities. Indeed, let z, be a root of a poly- 
nomial Q of the nth degree. Let kı be its multiplicity. Then 


Q(2-(G-—z)^Q(z (Qi) 9) 


where Q; is a polynomial of degree n— k,. If n—k; > 0 then, by virtue of 
the same theorem, Q, has a root Zz of some multiplicity k2, and therefore 


Qi(z) = (z— zia (z—z9)Y*0s(z) — (Qa(z1), Qo(z2) # 0) 


If the degree of Qo is positive the process can be continued. After a finite 
number of such steps we arrive at the conclusion that Q(z) possesses (pairwise 
distinct) roots z;, ..., z,, of multiplicities kı, ..., km, respectively, where 
n= k\+...+4,,, and- can be factored as 


Q(z) = a (z—ziya .. wee (z7 Zm)" (a, 0, n = Kyd- b ku) (7) 


There are no other roots of Q because, by virtue of (7), we obviously have 
Q(zo) # 0 for any zo # z; (j= 1,..., m). This shows that factorization of 
form (7) is unique for a given polynomial Q(z). 

Now we shall discuss an interesting relationship between the polynomial 
Q(z) in question and its derivative Q’ (z). It turns out that the greatest common 
divisor (factor) of Q(z) and Q'(z) (that i isa polynomial of the highest possible 
degree by which both Q and Q’ are divisible) is equal, to within a constant 
nonzero factor, to the polynomial 


L(z) = (z— zie ... (zz Fm} (8) 


for z; is a k;-fold root of the polynomial Q and hence there hold the condi- 
tions 


Q(z) = Q'(z) = ... = Q*7»(z) = 0, Q(z) # 0 
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whence we arrive at the conditions 
A(z) =... = 46-93(zg)-0, AGs-D(z,) #0 


for A(z) = Q'(z). They mean that (z—z,))s~! is a root of multiplicity k,— ] 
for the polynomial Q'(z). Therefore (z—z;)s-! is a common factor of Q(z) 
and Q'(z) while Q’ (zji is not divisible by (z — z;)'. Since this argument* can be. 
carried out for any j = 1,..., m we see that polynomial L is the greatest 
common factor of Q and Q’. If k; = 1 for some j then the corresponding 
factor in (8) is equal to 1. 

It should be noted that the polynomial L(z) can always be effectively found 
by means of the so-called Euclidean algorithm without computing the roots 
of L themselves. 

We shall remind the reader of this method. Let there be given two poly- 
nomials Mo and M, of degrees m and n respectively where m = n. Arranging 
them in descending powers of z and dividing Mo by M; we obtain a quotient 
Ro and a remainder M». The degree of the remainder is less than that of M;. 
Next we similarly divide M by M», the quotient being denoted Ri and the 
remainder Mi, etc. Since at each of this stages the degree of the remainder 
is reduced at least by 1 the process ultimately stops since the remainder turns 
out to be identically zero. We thus obtain the chain of the relations 


Mo = MiRo+ M2, Mı = M2Ri+ Msg, . 
My). = Mi_1Ri-24+ Mn Mi) = M,Ri-1 


where Rg and My are polynomials, the degrees of M; decreasing with the 
increase of k. These equalities show that 


G.C.D (Mo, M) = GCD (My My) =... = Mi 


where M; is G.C.D of Mo and M; (G.C.D means the greatest common 
divisor). 

The fundamental theorem of algebra only guarantees the existence of a 
root (which is complex in the general case) of a polynomial of the nth degree 
but does not provide any effective means for its computation. It should be 
mentioned that the proof of this theorem is carried out with the aid of ma- 
not given in our course is that it does in fact have a closer relation to the 
theory of functions of a complex variable which we do not treat here. 

There are formulas for solving general algebraic equations of the second, 
third and fourth degrees. As was proved by Abel**, there cannot exist such 
formulas for equations of degree n > 4. This should be understood in the 
sense that for n > 4 the roots of an equation aox"4-...-Fa, ix4- 0, = 0 
(ao = 0) cannot be expressed in terms of the coefficients a, with the aid of 


* In these considerations concerning the relationship between Q and Q’ it is also 
allowable to suppose that the coefficients of Q and the variable x are real. This very case 
will be of use in § 8.7. 

** N. H. Abel (1802-1829), a distinguished Norwegian mathematician. 
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functions of these coefficients reducing to a finite number of operations 
belonging to the following group: addition, subtraction, multiplication, 
division and extraction of a root. 

A polynomial Q(z) (see (1)) is called real if all its coefficients are real num- 
pers. A real polynomial, when regarded for only real z = x, is a real function 
Q(x) of the real variable x, that is a function assuming real values. 
~ An important property of real polynomials is that for any complex z 


there holds the relation D 
O@) = 00 (9) 


It is derived on the basis of formulas (14) in $ 8.2 (where it should be taken 
into account that, since a, are real, we have Gd, = ax) with the aid of the 
following calculations: 








n n n n 
a(z) = Y ayzk — X (yz^ = » az = 
k=0 k=0 k=0 


Let us prove the following theorem. 


eps 


ayzk = Q(G 


—_ 


Theorem. [fa real polynomial Q(z) has a complex root zo = c + iB of multip- 
licity k then it also has the conjugate complex root Zo = «—iB of the same 
multiplicity. 

Proof. By hypothesis, O(zo) = Q'(zo) = ... = Q'*-? (zo) = 0, Q9(zo) x 
# 0. It is easy to see that if Q(z) is a real polynomial then its derivative 
of the /th order Q(z) is also a real polynomial. Therefore, by (9), we have 


QUXzo) = QM(Z) for any / = 0, 1, 2, ..., and consequently 
Q(zo) = Q'(zo) = ... = Q*-D(z) = 0, . QUXz) = 0 
Using this theorem and taking into account factorization (7) for a poly- 


nomial Q(z) of the nth degree into linear factors we conclude that any real 
polynomial of degree n (a, 0) can be factored as 


Q(z) = a(z— aif ... (z— aj)" (22+ pizt qi) ... (22-+p,24+45)" (10) 


where a1, ..., Qj Pis .- -s Pss qis - --, Gs are real numbers, every polynomial 
z*4-pjz4-q; has a pair of (mutually) conjugate complex roots and n = /,+ 
+... +4+2(m+... 4-0 m;) 

Indeed, let us consider factorization (7). If among the roots z, entering 
into it there are real numbers we renumber them denoting ai, ...,a,. The 
corresponding powers in which the binomials (z— z+) enter into (7) will be 
denoted as h, ..., /,. 

If factorization (7) involves a factor (z—z,;)*" with a complex root z; then, 
by the above theorem, it necessarily involves the factor of the form (z— Zj)«, 
as well where k, = k, = k. On putting z; = «+i, (Z; = «— Bi) we obtain 


(z—zjf* (z— zj* = (z-a —Bi)* (z-a + Bi)* = [(z—aY-- BF = 
= (z-pzgq),  p=—2a, q=a?+f (11) 


where p and q are real numbers. 
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Now to complete the proof it only remains to renumber the factors corres- 
ponding to different pairs of conjugate complex roots of Q and to substitute 
them for the corresponding factors in (7), which results in (10). 


§ 8.5. Decomposition of a Rational Fraction 
into Partial Fractions 


In this section we shall consider an arbitrary real rational function 


P(x) 

I) = 96 (1) 
which is supposed to be a proper fraction. This means that P and Q are real 
polynomials and that the degree of P is less than that of Q. Let us denote by 
m the degree of P and by n the degree of Q; thus, m < n. The variable x 
will be supposed real so that f(x) is a real function. The degree of a polyno- 
mial M(x) will be denoted sy, (so we have sp = m and sg = n). 


Lemma 1. Let a be a k-fold real root of the denominator Q(x) of fraction (1): 
O(x) = (xa N(x)  (N(a) # 0) (2) 
Then fraction (1) can be represented in a unique way as 


Px A M(x) 
OG) ^ G-a* * a NG) 6) 


where A is a constant and the second term in (3) is a proper rational fraction. 
The number A is real and M(x) is a real polynomial. 

The uniqueness of decomposition (3) is understood in the sense that the 
numbers A and the polynomial M(x) (i.e. its coefficients) are determined 
uniquely. 

Proof. Suppose that equality (3) holds. On reducing the fractions on the 
right-hand side of (3) to a common denominator and equating the numera- 
tors on the right-hand and left-hand sides we obtain the identity , 


P(x) = AN(x)+(x—a) M(x) (4) 


which holds for any x. Putting x = ain it and taking into account that 
N(a) £ 0 we receive 





_ Pia) 
where the number 4 is real since P and N are real polynomials and a is a real 
number. The substitution of the value of A thus found into (4) leads to the 
(uniquely determined) expression 
P(x)— ANI 

M(x) = 9-09 (6) 
Since the numerator in (6) is a polynomial and A is chosen so that the poly- 
nomial turns into zero for x = a this polynomial is divisible by x—a and 
therefore M (x) is a (real) polynomial. By the hypothesis, Sp, sy «n— 1. 
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Therefore, by virtue of (6), su = n—2, i.e. sm is less than the degree (17— 1) 
of the denominator of the second fraction on the right-hand side of (3) and 
hence this fraction is proper. 


Remark, The lemma continues to hold for an arbitrary (not necessarily 
real) proper fraction (1) and a complex a with the exception of its last asser- 
tion since, generally, in this case A is a complex number and M(x) is not 
necessarily real either. 


Lemma 2. Let Q(x) be factorizable in the form 
Q(x) = (x?-+ px NE) (7) 


where p and q are real numbers, q—p?/4 > 0, k is a natural number and N(x) 
isa (real) polynomial with roots distinct from those of the trinomial x* + px4- q. 
Then fraction (1) is uniquely representable in the form 


Pœ) _ — AxtB M(x) (8) 
Qu) tpt  (xt+pxtq¥ Mx) 


where A and B are constants and the second fraction on the right-hand side of (8) 
is proper. The numbers A and B and the polynomial M(x) are real. 

Proof. Let us denote as a = «+ ifi and à = «— iB the roots of the trinomial 
x?+px+q(B » 0). As follows from the conditions of the lemma, these roots 
are also k-fold roots of the real polynomial Q(x). Suppose that representation 
(8) holds. On reducing the fractions on the right-hand side of (8) to a common 
denominator, clearing of fractions and equating the numerators on the 
right-hand and left-hand sides we arrive at the identity 


P(x) = (Ax+ B)N(X) d (X? - px4- 9) M(x) (9) 
Substituting the numbers a and d into it we obtain 
P(a) =(Aa+B)N(a) and  P(a)- (Aa--B)N (a) 








whence 
PO 4. Age Bu LO — (PIOY 7 
Aa4- B = Nay ^ 4 and A+B = N@ = (555) =A. (10) 


(by the hypothesis, N(a) = 0 and N(@) = 0). Equalities (10) is a system of 
equations with respect to A and B which should be solved in A and B. Its 
determinant is 


a 1l 


à l —-a—ü-2pi z0 








Hence this system is uniquely resolvable and its solution is real numbers 4 
and B. The last assertion can be proved without computing the solution A 
and B. To this end we pass to the conjugate complex quantities in equations 
(10): 


44+B=A and Aat+B=A (10) 
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The coefficients and the right members of systems (10) and (10^) completely 
coincide and therefore their solutions coincide as well: A = A and B = B. 
Therefore the numbers A and B are real. 
Now we substitute the numbers A and B found into (9) and receive 
M(x) = Er 


Since the roots of the trinomial x?-- px--q turn the numerator of the ob- 
tained fraction into zero (because of the choice of A and B) it is divisible by 
the denominator and hence M(x) is an (obviously real) polynomial. It can 
also be easily shown that the second fraction on the right-hand side of (8) 
is proper. The lemma has been proved. 

Lemmas 1 and 2 make it possible to decompose the given real proper ratio- 
nal fraction into the so-called partial fractions. Since Q(x) is a real polynomial 
of the nth degrec it can be factored as was indicated in$ 8.4 (10). Therefore, 
using this factorization and applying Lemmas 1 and 2 we consecutively find 
the decomposition (see the explanations below) 


P(x) AP M(x) _ (1 
Q(x) B (x-a)! (x— a) 7! N(x) 7 ) 
" Ap Aa M(x) a 
T (œa) (x-a) (aN) (12) 
_ AP Ay M, (x) 
T x- aya T Pa G-a) aN 77 (13) 
AP AQ AY 
= ame aui rent c Was x SR ern 
Es AP BOx-- co Büx4C$ 
s x— 4, GG pix 44) a^ x Fpax4q 
QR qm 2777 s Apta.. ( j 


where the constants A, B and C (supplied with the corresponding indices) 
are real and are determined uniquely. 

Relation (11) is based on Lemma 1; the polynomial M(x) entering into it 
is real and can be found from the equality 


Q(x) 2(x-a)hMi(x) (Ma) # 0) (15) 


The passage from (11) to (12) is also based on the application of Lemma 1, 
which is legitimate since the second fraction on the right-hand side of (l 1) is 
real and proper and Mi(a) = 0. The dots after (12) symbolize the continua- 
tion of the process of finding the partial fractions corresponding to the real 
root ai, this process being completed in (13). The dots after (13) symbolize 
the application of the same procedure for the other real roots. After (13) 
we consecutively write the partial fractions corresponding to the complex 
roots of O using Lemma 2. 
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This procedure has been described for the general case; in particular cases 
some of its steps may not be present. For instance, if Q has no real roots the 
procedure begins with the application of Lemma 2, and Lemma 1 is not used. 

It should be noted that the uniqueness of the numbers A, B and C (with 
various indices) in decomposition (14) has not yet been completely proved 
because their determination is connected with a definite process and, gene- 
rally speaking, this does not exclude the possibility that some other process 
may lead to other values of A, B and C. Below we present a method for 
determining A, B and C based on the comparison of the coefficients, and in 
the justification of this method it will be secn that these numbers do in fact 
form a uniquely specified system. 

Using Lemmas 1 and 2 we have already proved that for a given polynomial 
Q(x) and any polynomial P(x) with sp < so there is a system of numbers 
A, B, C, ... for which identity (14) holds (for all real x distinct from the 
roots of Q). Let us reduce the fractions in (14) to a common denominator, 
combine similar terms in the numerator, clear of fractions and then equate 
coefficients on the right-hand ‘side (they are linear combinations of A, B, 
C, ...) to the corresponding coefficients of the polynomial. P(x) in like 
powers of x. This results in a system of 7 linear algebraic equations in the 
unknowns A, B, C, ... The number of the unknowns and the number of the 
equations coincide here. As was shown, this system is solvable for any 
polynomial P(x), that is for any right-hand terms of the system in question, 
this was in fact proved with the aid of Lemmas 1 and 2. It follows that the 
determinant of the system is different from zero and consequently the system 
of the coefficients A, B, C, ... is in fact determined uniquely. 


Example. What has been said shows that there holds the equality 


ax®+bxitext+d _ Ax+B C D 
Q)--x4-1)(x-2Yy " al + (x—2y + x—2 
In other words, for any polynomial ax*+ bx?-- cx-- d of the third degree 
there are constants A, B, C and D such that the above equality holds for all 
x -# 2. To find these constants we reduce the fractions on the right-hand 
side of the given equality to the least common denominator. The numerators 
on both sides of the resultant relation must be equal: 


axi E bx?--cx--d = (Ax-F B) (x—2y-- C(xX? - x- 1) - D(x? 4- x 4- 1) (x —2) 


for x z& 2. By the continuity of the functions entering into this equality 
we can assert that it holds for x — 2 as well. On equating the coefficients in 
like powers of x we arrive at the linear algebraic system with the four 
unknowns A, B, C and D: 

a= A4D, c = 4A—4B-C—D, 

b = B—44+C—D, d = 4B+C—2D 

As is already known, this system is solvable in A, B, C and D for any 

a, b, c and d. Therefore, as is proved in algebra, the system of numbers A, B, 
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C and D serving as a solution to the linear equations in question is deter- 
mined uniquely for given a, b, c and d. 

We shall also discuss another type of the decomposition of P/Q in partial 
fractions which is based solely on the application of Lemma 1. 

Let 21, ..., Am be all the pairwise distinct (real and complex) roots of Q 
with multiplicities ki, ..., Km respectively. Let us consecutively apply 
Lemma 1 alone and the remark to the lemma in order to obtain the partial 
fractions of the form A/(x— A) corresponding to these roots. This results in 
the decomposition 


P(x) — AP AY , AQ . Am 

0 ^ w-A) te t wA T nt wt tera, 9 
where the numbers A are no longer necessarily real and may assume com- 
plex values. 


If, for instance, we want to find the coefficients corresponding to the root 
21 we multiply both sides of (16) by (x— 21^, which gives 


m 








(x— Any Gey = Al Ari A) ee 


fC on ere (17) 


where R(x) is a function having at the point A, derivatives of any order. 
It is therefore evident that 
1 P(x 
A-a = Jim o ga {OA o (8 
which shows, in particular, that the numbers A are determined uniquely. 
Formula (18) may be of use for practical computations. 

It should be noted that decomposition (16) obviously holds (see the re- 
mark to Lemma 1) for any proper fraction P/Q, not necessarily real. But in 
the. case of a real fraction there is a characteristic feature which does not 
apply to complex fractions. Namely, in decomposition (16) of a real 
fraction P/Q every term of the form 4/(x— A) has a real coefficient A for any 
real root A while for any complex root A there necessarily appear both terms 
A[(x— Ay and Aj/(x—A). It is this fact which we have mentioned as a feature 
of decomposition (16) for real fractions. 

Indeed, we can write 


Pix) ^ 4 B 
Qo) T -Aa + G-I t n (19) 
Passing to the complex conjugates in (19) and taking into account that the 
fraction P/Q and the variable x are real we obtain 
Pe _ A B +. 
ax) ~ ‘Gor Ha 


By the uniqueness of the decomposition, it follows from (19) and (20) that 


(20) 
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z 4 . : 
A= B. Note that the sum ea te p a real function of x (the 


variable x is real) since it involves the pair of mutually conjugate complex 
summands. 
8 8.6. Integrating Rational Fractions 


Let us consider the indefinite integral 
P(x) 

Saar QU id () 
of a real rational fraction PIQ on an interval containing no real roots of 
Q(x). The function P(x)/Q(x) is continuous on such an interval and its anti- 
derivative makes sense. If the degree sp of the polynomial P is not less than 
the degree so of Q (sp = sg) we begin with the division of P by Q following 
the well-known algebraic rules: 

PX Pi 

SARI 
The integration of the polynomial R is carried out quite simply; the expres- 
sion P1/Q is a proper rational fraction, and hence the whole question reduces 
to the integration of the proper fraction P1/Q which we shall again denote 
as P/Q. 

Let us suppose that Q is factorized as written in $ 8.4 (formula (10)). 
Then P/Q can be written in the form of the decomposition into partial 
fractions in accordance with formula (14) of § 8.5. As is already known, 
each partial fraction can readily be integrated in elementary functions. 

We have shown that, at least in principle, the integral of any rational 
fraction can be expressed in terms of elementary functions. The practical 
integration can be completed if all the roots of Q and their multiplicities 
are determined. As was mentioned in § 8.4, this is by far not always possible 
in the analytical sense. In this connection it becomes clear that various 
simplifications of integral (1) are extremely important for practice. One of 
such simplification techniques suggested by Ostrogradsky* will be discussed 
in § 8.7. 


8 8.7. Ostrogradsky's Method of Integrating 
Rational Fractions 


Let it be necessary to find the indefinite integral 
P(x) 
Q(x) dx 0) 


where P/Q is a real proper rational function (i.e. a real proper rational 
fraction) and the polynomial Q is of degree n. Before proceeding to Ostro- 
gtadsky’s method we shall discuss some purely theoretical facts needed for 
our further aims. 








* Academician M. V. Ostrogradsky (1801-1862), a prominent Russian mathematician. 
20006—22 
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Let Ay, ..., 4m be the pairwise distinct (real and complex) roots of Q of 
multiplicities kı, ..., Km respectively. Let us decompose P/Q following 
the scheme of $ 8.5 (16). This decomposition can be written as 


Pa) v 4 
Day = LEAF Q) 


where A, 4 and k must of course be supplied with the corresponding indices, 
We can also rewrite (2) in the form 


P A 
Q mm Lot +2 oe (3) 


where the first sum involves all the partial fractions with the first powers of 
(x— 4) and the second sum contains all the other partial fractions. Each of 
these sums is a real function of x although, in general, some of their terms 
may be complex (see the end of § 8.5). 

On reducing the fraction in the first sum to a common denominator we 
obtain 








N(x) E Á bor bx. b, xm! 
K(x) 2 Xx—4A (x-2)... (x— 2m) (4) 


(N/K is a real proper fraction). The integration of the second sum is readily 
ii the integrals being expressed in terms of rational functions: 





A 
| ear (x- ax 4 E x= D upay te = 
Gg ax ooa mae m! Me 
= D Er tC = tc (5 


We have performed here the termwise integration of men which, in 
the general case, are complex-valued (see § 8.3 (12). But the ultimate 
expression is a real function since each summand it contains is either real 

` or enters into the sum together with its complex conjugate. The expression 
MIL is obviously a proper fraction; the arbitrary constant C is taken real 
here. 

What has been said shows that the integration of equality (3) yields 








P(x) _ M(x) N(x) dx 
fo ^ = 1 K(x) (6) 
where 
K(x) a (x—A1) see (x— 2m) (7) 
and 
L(x) ms (x— å): t; (x— A, Yn7! (8) 


(the arbitrary constant on the right-hand side of (6) is included in the inde- 
finite integral entering into it). 

We have thus proved that for a given Q and any polynomial Pe Pot 
+pixt...+pn-1x°"! there are do, Ai, ..., An-m-1, Do, ..., b (their 


INDEFINITE INTEGRAL. PROPERTIES OF POLYNOMIALS 339 


total number is 1) such that for the polynomials M(x) and N(x) with these 
constants as coefficients there holds equality (6) in which M/L and N/K are 
proper fractions. 

Let us show that M and N can be effectively found without computing 
the roots of Q. To this end we differentiate (6): 


PM ma IMP i 

Q \L X LEUR GE 
From this relation, on reducing the fractions on the right-hand side to the 
common denominator Q — LK and equating the numerators of both sides, 
we derive 


P = KM MEE 1 iw (9) 


Since K and L are expressed by formulas (7) and (8), and L’ involves the 
factor (x—21)6-? ... (X— Åm) (k; — 1), the product KL’ is divisible 
by L and hence KL’/L is a polynomial. 

Now we add together the polynomials on the right-hand side of (9), 
combine similar terms with like powers of x and equate the coefficients of the 
resultant expression to the corresponding coefficients p, of the polynomial P. 
This leads to a linear system of algebraic equations of the form 


xo + $e oo MET NES + Bebo + "re TL bh, = Pk (k =. 0, emery n) 
(10) 


with the unknowns a; and b;. This system is in fact linear because the right- 
hand side of (9) is a linear combination of the polynomials M', L' and N 
which alone contain a, and by. 

The coefficients x and f, of system (10) are known; they are determined 
by the given polynomial Q and are real. The determinant of system (10) is 
sure to be different from zero. This is implied by the fact that to the right-hand 
side of (10) there corresponds a definite polynomial P(x) to which, in their 
turn, there correspond the numbers A entering into decomposition (2) from 
which, with the aid of (4) and (5), the numbers a, and b; are found, the latter, 
as was proved, satisfying equations (10). In other words, system (10) is 
solvable for any right-hand members whence follows that its determinant is 
nonzero. Since the numbers «;, 8) and p, arc real the polynomials M and 
N are also real. 

It should be noted that the factorization of Q in linear factors and the 
introduction of the numbers A were only involved in the considerations to 
justify the method. The polynomial L can be obtained practically with the 
aid of the Euclidean algorithm and the polynomial K can be found by 
dividing P by L. Therefore the determination of the roots of Q is not in 
fact needed. To obtain system (10) we simply write the sought-for poly- 
nomials M and N in the form 


M (x) = Ag t+ dyxd-... Fa, 1x77 771 
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and 
N(x) = bot byxt... 4b cix 


(where the coefficients a; and b, are not yet known; this is the well-known 
method of undetermined coefficients), substitute these expressions into (6), 
differentiate the resultant relation and, finally, equate the coefficients of the 
numerators in like powers of x. 

As to the expression N/K, its integration can only be completed with the 
aid of the techniques presented in this chapter when the roots of K (they are 
all simple, that is of multiplicity 1) are known. In this connection it should 
be mentioned that there are approximate methods of integration of functions 
which are applicable irrespective of whether or not the integral of the given 
integrand function is expressible in terms of elementary functions. If it is 
required to find an approximation to the integral of a rational fraction P/Q 
it is advisable first to apply Ostrogradsky's method in order to find its 
rational part and only then perform an approximate integration of the 
remaining part N/K. 

We also note that the decomposition of N/K into partial fractions (see 
(4)) may involve some terms A4/(x— 4) with real 2. The integral of such a 
term has the form 





f 4 dx — Aln|x—2A|4-C 


x—4à 


In case A = «4- if is a complex root, sum (4) involves both the term A4/(x— 

— 2) and its complex conjugate A/(x— 4). The sum of the two terms is 
A + A __ Bx+D 
x-2 ' x-À | (x-ay«g 

where B and D are some real numbers. The integration of such a fraction 
leads, as we know, to the logarithmic function and to the arc tangent. Hence, 
the integration of a rational fraction N/K leads, in the general case, to 
transcendental (not rational) functions (i.e. to the Jogarithm and the arc 
tangent). 


Example. Let us find the integral | The denominator of the 


integrand in this integral has multiple roots and therefore it is advisable to 
use Ostrogradsky's method. We represent the integral in the form 


dx —  aQtaxtax bod bx t bux* 
Jy = SE [ong ds 


where a; and b; are the constants to be determined. On differentiating this 
equality and reducing the fraction to the common denominator (x?— 1)? we 
obtain 





1 (oratory + bo bux t bu 


wy = x1 
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Equating the numerators we find 
1 = (x9— 1) (2a2x+ a1) 3x? (ao+ a1x + a2x2) + (x — 1) (box? 4- b 1x +p) 


whence, comparing the coefficients in like powers of x we arrive at the linear 
system of equations 


bs = 0, bi—as = 0, bo—2a, = 0, bs4-3ae = 0, bi+2az = 0, bo+a, — —1 


The solution of the system which is easily performed results in the final 
expression 


f dx 1 x +f dx 
(8-1)? ^ 3 x8-1 3 J x3-1 


Now let us find the same integral by using the decomposition of the inte- 
grand fraction in partial fractions: 


1 A Bx+C 
x-] 7 x=1 tapati (11) 


On clearing of fraction we get the identity 
1 = A(x*- x 4-1) - (Bx - C) (x— 1). 


holding for any x. The substitution of x = lin it gives 4 = 1/3. Comparing 
the coefficients in the highest power of x and the terms not involving x we 
also find 0 = A+B and 1 = A—C, whence B = —1/3 and C =—2/3. It now 
only remains to substitute the values of 4, B and C thus found into (11) 


and to perform the integration, which, of course, leads to the same final 
result as above. 


8 8.8. Integrating Irrational Expressions 


We shall use the symbol R(x, u, v, ..., w) for a rational function of 
X,U, V, ...,W(wetakea finite number of letters denoting the corresponding 
variables). Such a function is obtained by applying to x, u, 9, . .., wa finite 
number of arithmetical operations (addition, subtraction, multiplication and 
division). 

The integral 








ax+b\a ax+b ya 
[86 (Sa) oe (Sea) ) 4 (1) 
where A, ..., u are rational numbers with the lowest common denominator 
m, is reduced with the aid of the substitution 


ax+b 
cext+d 


m= (ad—be # 0) (2) 
to an integral of a rational fraction (as we say, it is rationalized). Indeed, it is 
obvious that x is expressible as a rational function u(f) of £ and, together with 
x, the function p(t) entering into the differential dx = v(t)dt is also rational. 
Therefore, denoting by p,..., q, respectively, the numerators (which are in- 
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tegers) of the fractions A,..., 2 (which are reduced to their common deno- 
minator m) we see that substitution (2) transforms the integral to an integral 
of the form 


f R(u(®, t? ,..., 9) (dt = | Ri(t) dt 


where R() is a rational function of t. 











Examples 
1. TES =2 [+e ar (¢=Yx—1, x 2 148, dx = 2tdr) 
aa J 
' d 6r P 2 pu 
2. | seva = ape d = 6 | arr dt = 6 [ü7 reai- 6] ET 


(x = ^. dx = 68 dr) 


8 8.9. Euler's Substitutions 


Euler's substitutions are used to rationalize an integral of the form 
f R, ydx  (yslatbxtox) (1) 


where R(x, y) is a rational function of x and y. 
The first substitution is used in the case when the roots œ and 3 (« = B) of 
the trinomial a+ bx-- cx? are real. It has the form 


_ Vatbxtex® _ Ve(x-a)(x—A) 


f x-z z x—@ (2) 
which is equivalent to £ = m . 


Here both the function x = g(r)and its derivative g’ are rational functions 
and hence 


J RE, ax = | R((0.119(0)—21) (0 4t = f iO dt 


where R, is a rational function. To return from ¢ to x we use formula (2). 
The second substitution. Let the roots of the trinomial a-- bx-- cx* be com- 
plex. In this case we must suppose that c > 0 since, if otherwise, the trinomial 
is negative for all x. 
Let us put 


y 2 txzxyc (3) 
On squaring this equality and replacing y? by its expression we receive 
a+bx = fT2IxVc 
whence 
Ü—a 


Bev p(t), dx = q/(r) dt (4) 
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Therefore 
J Ro de = [ ROO, EAW) ear = f Rat 


where R(t) is a rational function of t. To return from z to x we use the inverse 
transformation 


t= Vatbxtexr®txye (5) 


Remark. To the first substitution y = t—xyc (see (3)) there corresponds 
the function (see $ 5.8, Example 3) 


r-a 


b+2YVe 


Its graph splits into two continuous branches corresponding to the variation 
of t over the intervals (— œ, —b/2/c) and (—b/2¥c, œ=) respectively. It 
is strictly increasing from — œ to + œ on either interval. To these branches 
there correspond the two one-valued inverse functions 


t= xyetYatbx- ci 


The first of them (involving the sign “+ ") has been used in substitution (5) 
rationalizing the given integral, the second one only differing from the former 
in sign. 

We also note that the substitution x — 1/z transforms the square root of 
the trinomial to the expression az? + bz + c/(+z) (incase a = 0) and hence 
brings integral (1) to an integral of the same type. Here the sign “+” or 
* —" is taken depending on whether the interval of variation of z is a part of 
the ray z > Oor z < 0. Generally speaking, this substitution performs a dis- 
continuous transformation: under the transformation a neighbourhood of 0 

' goes into a neighbourhood of the point at infinity and vice versa. Therefore 
this substitution transforms a function continuous on the x-axis into a func- 
tion of z which, in the general case, has a nonremovable discontinuity at 
z = 0. If the integrand function R(x, y) in the original integral has a discon- 
tinuity at the point x = 0 the substitution x = 1/z does not aggravate, in 
this sense, the situation. 


Examples 
dx 
. dox Vac bxta? 
Suppose that the trinomial in the denominator has complex roots. Then the 
computations are carried out as follows: 





1. Consider the integral f 


dx f dx dt bow Ta Eod 
J aie Se Í amr = Mi gtxtVa+bx+x |+c 
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Here we have used the second substitution 
2dt 


Va+bx+x? = t—x, a+bx = t—2tfx 
bdx = 2tdt— 2t dx— 2x dt, oe = = 5X3t 


| 


In particular, 
= In|x+Vx?+al|+C 
MC — REE _ NC _ 
") ( EN 5 | y&-(uy | VE 
2 
x— > = at) 


dx = 
Yarbx-x — ly 15 
(=) 
= arc sin T +C (a+ =a? >0 


In the integrals below it is assumed that the roots of the trinomial in the 
denominator are complex (the upper sign corresponds to positive values of 


x and z) 
dx 
3. ——— - ——— - 
Í xV ax?-Ebx 41 d 
+C=Fin| 4 1Yactbxti |, 
-b C= 


= Fln |$ +z+ya+bz+z 
z 2z 
= Fare sin ———— 
T Vb*3-4a 
Laine pe 


x 








4. 
[Rh tfm 
= arc sin VE ds 
In particular, 
dx juro 
at = Farc sn +C 
= can be reduced 


5. The integrals | —————— ar 
iu egnis | Tirto loaa 
to the foregoing ones if we introduce, respectively, the new variables z = 


= yic] x and z = Ylel(x— m) 
§ 8.10. Binomial Differentials. Chebyshev's* Theorem 
(1) 


Let us consider the integral 
f x(a-+-bx")? dx 


* Academician P. L. Chebyshev (1821-1894), the great Russian scientist who con- 
tributed many outstanding results to mathematics and mechanics. 
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where a and b are arbitrary nonzero numbers and m, n and p are rational 
numbers. The element of integration x"(a 4- bx")? dx in (1) is termed a binomi- 
al differential. 

The substitution x" = 7, x = £n, dx = (1/n) (0/9-! dt brings (1) to the form 


= f 17m-Xa--bry de (2) 


On putting (m+ 1/n)—1 = q we reduce the integration problem to an inte- 
gral of the form 


Í 1(a+bt)? dt (3) 


where p and q are rational numbers. 
If at least one of the numbers p, q and p+4 is an integer ( positive or negative 
or zero) integral (3) can be expressed in elementary functions. 


Indeed, if p is an integer the.integral has the form f R(t, t?) dt where q isa 


rational number. If q is an integer then it has the form f R(t,(a+ bt)?) dt where 
pis a rational number and, finally, if p +q is an integer then the integral can 
be written as f wera y dt. 


As we already know (see $ 8.8), all the three integrals can be transformed 
with the aid of the corresponding substitutions to integrals of rational func- 
tions. 

Chebyshev proved a remarkable theorem stating that if for given rational 
numbers p and q none of the three indicated conditions is fulfilled integral (3) 
cannot be expressed in elementary functions. 











Exercises 
Find the integrals: 
q4 [EE. a. ee xv? qx. 
`J yx-il^ lam 7 SS pen a 
dx 5 5/3 F 
4. [aS 5. [2 x dx; 
dx 
6. assse-qi n 
Show that 
dx 1 xy2 
J| ass y2 i "Vine V 
dx 1 V1xxexy2 
oOo = — Ìn EE EE C 
Jas 22 estes | 
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§ 8.11. Integrating Trigonometric Expressions 


Let us consider the integral 


f R(cos x, sin x) dx (1) 
where 
P(u, v) 
RY v) = ry Q) 


is a rational function of u and v (i.e. P and Q are polynomials in x and v). 
l. If one of the polynomials P and Q is an even function of v while the 
other is an odd function of v we can represent R in the form R(u, v) = 
e Min, v^)v vv 
“Nu, v). t?) 
nator in (1) by v) where M(u, v) and N(p, v) are polynomials in p and v. 
Therefore the substitution ¢ = cos x reduces integral (1) to the form 


f R(cos x, sin x) dx = -Í Me ce dt — | R(t) dt 


(by multiplying, if necessary, the numerator and the denomi- 


where R(¢) is a rational function of ¢. 

2. If one of the polynomials P and Q is even as function of u while the other 
is an odd function of u the substitution Z = sin x rationalizes the integral, 
which is proved in the same manner as above. 

3. If (i) the polynomials P and Q do not change when u and v are replaced 
by —u and — v respectively or (ii) both polynomials change sign under this 
transformation of the arguments u and v, then integral (1) can be rationalized 
by the substitution 


t = tanx (3) 
(or t = cot x). 

We shall limit ourselves to the first case because the other case can be. 
reduced to the former with the aid of the multiplication of the numerator and 
the denominator of the fraction in (2) by u or v. 

Every term of the polynomial P has the form 


uM. owe u^ 
Auw = A (=) yltm = Aylyltar (v E v! i 


where A is a constant coefficient. Therefore 
P(u, v) = M(w, $?) = Yan) (4) 
is a polynomial in w and v? (see the end of § 5.9). 
The sum on the right-hand side of (4) extends over a finite number of terms, 


x(w) are some polynomials dependent solely on w, and s are nonnegative 
integers. We similarly conclude that 


Q(u, v) = N(w, v?) = »' Bw) vo 


is a polynomial in w and v?. 
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By substitution (3), we have sin?x = P/(1+/) and dx = dtj(1+f); hence 
integral (1) is transformed as 
"n 
M (: za) dt 
RETE E ee = | (À dt 
N (. i ze +P) 
where r(t) is a rational function. 


4. For any rational function R(u, v) the substitution ¢ = tan x/2 rational- 
izes integral (1). Indeed, we have 





1 —tan 3 l-e 
cos X = ————— = ~- 
l+tan? = "d 
2 
x 
; ] En 21 
sin X = - x = TE 
1 3-tan* 3 : 
1 x ] : 1 
dt = -z sec? 3 dx = 3 (+)dx and dx= is 
5. An expression of the form 
" 
T(x) = + x (a, cos kx-+by sin kx) (5) 


where a, and b, are constant coefficients is called a trigonometric poly ‘nomial 
of order n. The integral of (5) is pul found: 


f T,(x) dx = E xt y T (ax sin kx— by cos kx)--C (6) 
B k=l 


We often deal with expressions of the form 
.cos™ x cos! x,. cos" xsin’x, sin" x sin! x (7) 


where m and / are nonnegative integers. These expressions are trigonometric 
polynomials of order m--/, that is they can be brought to form (5) with con- 
stant coefficients a, and bg. This can readily be proved by induction. 
Indeed, we have (see the explanations below) 
iz ote in 
cos” x = ( xe ) 





= x (eins 4- Clem -2)x 4 Ev enim) = 
] 
= Se (cos mx+Cl, cos (m—2) x - ...--cos (—mx)) (8) 
Here one should take into account that cos” x is a real function and there- 


fore the last term in this chain of equalities is obtained from the preceding 
term by taking its real part. The imaginary part of cos" x is automatically 
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equal to zero. On replacing x by (x+2/2) in (8) we obtain, depending on 
whether m is even or odd, the expressions 


or (cos mx—C1, cos (m—2)x+ C2, cos (m—4)x+... 


.. +(— D" cos(—mx)) (9) 


sin" x = 





or 


sin" x = on (sin mx—C}, sin (m—2)x+ ...) (10) 


The fact that expressions (7) are trigonometric polynomials of the indi- 
cated order follows now from (8)-(10) and from the relations 


sin Ax cos ux = + [sin (4+ p) x - sin (A— p) x] 











cos Ax cos px = + [cos (A+ i) x - cos (A— u) x] 2 
LU 
L laces sin x cor x laces E = In |tan x|-C 
(substitution "n 
[x ilmeen = | SD = i Itan eI +0 


{substitution 4, § rr 


3 f dx = f dx = 
~ J atbcosx a(cos* (x/2)+ sin? (x/2)) + b(cos? (x/2) — sin? (x/2)) 
B dx E 2 dt 
= J [a(1 + tan*(x/2)) +6(1— tan? (x/2))] cos? (x/2) B J a(l+)+6(1-—P) 


(substitution 4, § 8.11). 
NE ie dx : dx 
4. f a+bcosx+ csinx — f a+r cos (x—9) 


where the constants r and 9 are chosen so that b = r cos p and c = r sin g. 
Hence this integral is reducible to the foregoing one. 


5. f sin’ dx = — [ (1—cos? x)? d(cos x) = — [ 1-2} ar. 
6. Jay = — f (cot? x}? d(cot x) = - [a exar. 


* [az e [OEY e | Sa (ied) 


8. {= * dx = -|E a (£ = cos x). 


cos! x 
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» [sinta de = J (EB de Lf (12 cos 2e 1E) ae 


10. f sint xcos? xdx = f (=F (8E) dx = 
1 


- il (1—c0s*2x) (1 —cos 2x) dx = 3 f [ ~(=%5*)] (1 — cos 2x) dx 


(further computations are performed with the aid of formulas (11)). 


dx dx dt 
i. loans = I. tan? x) ae eter 





= 5 arctan (4 tan x)+C (t = tan x). 
d IE dx = 2 | zcese cca tl [2+cos x| = 
ES 2f Ta GTB O =a + |2+€08 xl = 
= 2f raang tI l2+ cosx] = 4 f re; * In |2+cos xl. 


8 8.12. Trigonometric Substitutions 


Integrals of the form 
(1) f R(x, Va?—x®) dx, (ii) f R(x, Va?+x*) dx, 
(iii) I R(x, V x?i— a?) dx 


can be transformed to integrals involving rational expressions in sin ¢ and in 
cos t by means of the following substitutions (called trigonometric substitu- . 
tions): l l E 


(i) x = a sin t, whence dx = a cos t dt and yaà?— x? = a cos t 
(ii) x = a.tan t whence dx = a cos~* t dt and Y@+x? = a cos! t 


(iii) x = a sec t whence dx = a tan t sec t dt and V x?£— a? = a tan t 


Example 
| Ve- ax = J acos t acos tdt = a | A482 qe = 


= 2 (Ec = © (resin t y1—sin? t)+C = 


x? 


_ @& - x , x _ sx, x 
= 2 (arcsin = 4% 1-2) ec = (arcsin 244 y +C) 


(x = asin t) 
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vt 


z 3.13. Some Important Integrals Inexpressible 
in Terms of Elementary Functions 


that the indefinite integral of the function e~** which plays 
_.« role in the theory of probability cannot be expressed in terms of 
elementary functions. The same applies to the integral of the function MI 
often occurring in mathematical analysis. : NEN 
The following important integrals are also encountered in applications: 


: dx x? dx 
| ————— Ses 
VO- (-#e) Vax) ae) (1) 
[ dx (0 < k « 1) 


(L--Ax5) (52) (1 — 2x2) 


They are known as elliptic integrals of the first, the second and the third kind 
respectively. The first two of them involve the parameter k and the third one 
depends on k and on the additional parameter A. It can be proved that none 
of the three integrals is expressible in terms of elementary functions. i 
The substitution x = sin p (0 = p = 2/2) transforms the first of the inte- 


grals to 
| (2) 
yi- c sing 


the second to 
1 — k? sin? y d 
-g fii p dp (3) 


= [7S 
ke YI- ksin" o 


and the third one to 
I ry dp m (4) 
(+A sin? p)y1— «? sin” P 


In (3) there appears the integral 
[ Vi sin? p dr (5) 


distinct from (2). Integrals (2), (5) and (4) are called elliptic integrals of the - 
first, the second and the third kind, respectively, in Legendre’s fe orm". 

There is extensive literature devoted to elliptic integrals. It includes tables 
of values of some important definite integrals corresponding to them, in 
particular tables of values of the definite integral corresponding to (5) taken 
over the interval (0, 2/2). 


* A. M. Legendre (1752-1833), a French mathematician. — : 
** By the elliptic integrals of the first, second and third kinds in Legendre's (normal or 
standard) form are usually meant some concrete antiderivatives of — 2 ___ ; 
y Vi kiini p 


YIS ny and ——— 7, namely those equal to the definite integrals 
(L+h sin? g) 1 —K* sin? 9 


of these functions taken from 0 to the variable upper limit 7. — Tr. 


CHAPTER 9 


Definite Integral 


§ 9.1. Introductory Remarks. Definition 


The notion of the definite integral was already discussed in § 1.7. The 
reader is advised to recall the content of this section before proceeding to the 
study of the present chapter devoted to the theory of the Riemann* definite 
integral. 

We begin with the formal definition of the Riemann integral. Then we in- 
vestigate its properties and establish conditions on the integrand function 
which guarantee the integrability (the existence of the integrals); we also 
study some applications of the definite integral and present the theory of 
improper integrals. As will be seen, for a function to be integrable in the sense 
of the proper Riemann integral it is necessary for it to be defined in a finite 
interval and be bounded on it. The (proper) Riemann integral does not exist 
for unbounded functions. But it is possible to define the notion of an im- 
proper (Riemann) integral which involves a two-fold passage to the limit. The 
introduction of the notion of an improper integral makes it possible to state 
acorrect definition of the area of a figure bounded by the graph of a function 
which tends to infinity at some points but not too fast. Another type of im- 
proper integral is introduced for a function defined throughout the real axis. 
With the aid of this type of integral it is possible to compute the work ofa . 
force acting upon a body along an infinite path of motion. 

Let us consider a function f defined in a finite closed interval [a, 6] and 
divide the interval into n parts with the aid of points of division a = xo < x1 < 
<... < Xa = b. Such a construction will be referred to as a partition R 
of the interval [a, b]. On choosing an arbitrary point 5; in each subinterval 
[xi Xi41] (£i € [xo Nina; 7 = 0,1, ..., n— 1) we form the sum 


aml 
S=Sr= Y SÈ) dx, 
i=0 
called a Riemann integral sum (for the function f defined on the interval 
[a, b]) corresponding to the partition R. Such an integral sum is not uniquely 


* G. F. B. Riemann (1826-1866), a distinguished German mathematician. 
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determined since it depends not only on the function fand the partition R but 
also on the choice of the intermediate points £; € [x;, x;4 i]. 
The Riemann integral of f on |a, b] is defined as the limit 


b 
lim S f) au = [49471 (1) 


max dxj-0 j;=9 


In other words, by the (Riemann) definite integral is meant a number 7 
such that, given any € > 0, there is 6 > O such that the inequality |\Sr—I] < 
<E holds for all partitions R in which Ax; < ð, irrespective of the choice of 
the points £j € [xi, xi41]. 

Another equivalent definition of limit (1) is the following: given an arbi- 
trary sequence of partitions Rk = (a = xj < xf « ... < xh, = b}, for any 
definite choice of arbitrary intermediate points £f € T, X41] for every k, 
such that max Ax* -- 0 as k — œ, the corresponding sequence of integral 
sums has the limit 


Jim n SR, = = jim X SEK) Axt = I 
=e j=0 
(independent of the choice of R* and £f). 

The equivalence of the two definitions of limit (1) is proved by analogy with 
the proof of the equivalence of the definitions of the limit of a function stated 
in terms of e, ó-formalism and in terms of sequences. 

The existence of the integral can also be expressed in terms of Cauchy's cri- 
terion: for any £ > 0 there is 5 > 0 such that for any partitions R and R’ 
with subintervals of length not exceeding ô the inequality |Sr—Spr| < € 
holds. 

A function f for which integral (1) exists is said to be Riemann integrable 
(in the proper sense). 


8 9.2. Boundedness of Integrable Function 


Theorem 1. If a function f is integrable on an interval [a, b] it is bounded on 
that interval. 


Indeed, suppose that f is unbounded on [a, b], and let Sp = p SE) Axy 


be its integral sum corresponding to an arbitrary partition R. Since fis un- 
bounded on [a, b] it is unbounded on at least one of the subintervals [xj 
Xj4.1] of the partition, say on [xy xj,4.1]. Then we have 


Sg = f(5) Ax Y SE) dx; = f) +4, A= YSE) Ax 
where the sum )"' extends ove. all j # jo. We consider all £, entering into 


this sum as being arbitrary but fixed. It follows that |.S | = | /(5,)] 4xj,— lAl. 
Let us choose an arbitrarily large number N and write the inequality 


IPG) 44-141 >N, ie rE o IE 
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The unboundedness of f on [x,, xj.+1] guarantees the existence of a point 
E € Di» X41] Such that this inequality is fulfilled. 

We see that if f is unbounded on [a, b] then, given any number N > 0 and 
any partition R, there is an integral sum corresponding to R such that, due 
to an appropriate choice of the points £j, it exceeds N in its absolute value. 
This means that f is not integrable on [a, b]. 

In what follows we shall only consider bounded functions (in the theory of 
the proper Riemann integral). 


§ 9.3. Darboux* Sums 


Let f(x) be an arbitrary bounded function on (a, b] and let R = {a = xo < 
< X1... X, b) be an arbitrary partition of [a, b]. Putting m; = 
= inf f(x)andM,= sup f(x) we form the sums 

XE [x xy,àil x € [x xal 

Spr = Yom 4x and $4,- Yu 4x; 
j= J= 
which are called zhe lower and the upper Darboux sums, respectively, corre- 
sponding to the partition R (a more precise notation is Sr(f) and Sa( n) 
These are definite numbers dependent solely on f and R. 

It is evident that Sr = Sp. 

Let Ri, Re and R3 be some partitions of [a, b]. If all points of division 
entering into R; belong to the system of points of division with the aid of 
which Rs is formed we shall say that R» is a refinement of R and shall write 
Ric Ro. If the set of points of division of R; is the set-theoretic sum of the 

_ points of division entering into R, and Re we shall write R = Ri+ Rə. 

If R c R' then 


Sr Sem Se m SR (1) 
Indeed, let 

= {xo <X1<...< Ny 
and 

R = {xo = X0,0 < X01 < ...- Xo = X1 X10 c Xnicme.. 
s.. S Xn 2, dyes = Xag—1 = Xqa—1,9 79... Xiii, Ya = Xn} 
Then, obviously, 
My = sup fs sup /f/=M; 
xE, p 3j, E] x € [xy, X41) 


-and 
Spr = F T My, Ax, < bi M; T AX jx = P M; J Xj = Sg 
j=0 k=0 j=0 


whence follows the last inequality (1). The first one is proved analogously 
(the middle inequality (1) has been already established). 

Given any partitions R4 and Rə, there holds Sr, = Sp, because Sr, = 
= Sg n. E Sgen, = SR. 





* J. G. Darboux (1842-1917), a French mathematician, 
2000623 
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Now let us fix Ry, and let R be arbitrary; then 
Sg, = Sp and, consequently, Sr, «inf Sp = I 
R 


The number 7 = inf Sp is called the upper ( Darboux) integral of the function 
R 

f on [a, b]. We have proved the existence of the upper integral and the fact 
that for any R (we now replace R, by R) there holds 

Se = "n 
It follows that there cxists the supremum 

I = sup S, «7 
R 


which is called the lower ( Darboux) integral of f on [a, b]. Hence, we have 
established the existence of the lower integral J and the upper integral J of f 
on (a, b] and the inequality 7 = Z. 
Lemma 1. Jf E, and E» are point sets in the real line then 
sup (x+y) = sup x4 sup y 
x€ Et x€E, EE 
YEE: 
The proof is left to the reader. 
Lemma 2. Iff is a bounded function defined on a closed interval [c, d] then 
sup [E-M] = sup |/(—/(|- M-m (2) 
8, n€ [e d] & ue d) 


where M = M,a = sup f(x)aud m = ime, = inf f(x) 
x € fe, d] x&[o, d) 


Proof. For any £, € fc, d] we have 
KE- = iE- = M-m (3) 
On the other hand, there are ¢, 1 € [c, d] such that f(é) > M —2/2 and f(n) < 
< m+e/2; for such é and 7 we have’ l | l 
SE- (n) > (M—&[2)—- (m+ £/2) = M- m-e ` 
Hence, we have proved that the first and the third terms in (2) are equal. 
Then, moreover, (3) shows that they are equal to the second term in (2). 


The number 
M—m = = oy, d 


is called the oscillation of f on [c, d]. 
It follows from Lemmas 1 and 2 that 


n—1 n-l 
sup  Y1/(5)—/() dx, = Y, sup | SENS). dx, = 
j-o 


Spy € [xp Xp) go 
a-l a—1l 
= X (M,— mj) dx; = Y o; x; = Sr— SR, 0j = Ox 541] (4) 
j=0 jc 
(all these relations involve the sign of strict equality!). 
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§ 9.4. Key Theorem 


Theorem 1 (Key Theorem). Let f be a bounded function defined on a finite 
closed interval [a, b]. 

The following four properties are equivalent: 

Qr 


(il) for any £ > O there is a partition R such that 
S R— SR <E (1) 


(iii) for any = = O there is 6 > O such that inequality (1) holds for all parti- 
tions R with subintervals Ax; < 6; 
(iv) the integral 
b 


[fO) dx o: (2) 


a 


exists and I = I= I. : 

Here it is meant that J and J are the upper and the lower integral of / on 
[a, b] respectively and that Sp and Sp are the upper and the lower Darboux 
sum of f corresponding to the partition R. It should be noted that for an 
arbitrary bounded function fon (a, b] these properties may not hold but if at 
least one of them holds then the other three hold as well and if one of them 
fails to hold so do the others. 

The key theorem can be restated as follows: 

For the integral of f on [a, b] to exist it is necessary and sufficient that (at 
least) one of the conditions (1)-(ii1) holds. Then the value of the integral I coin- 
cides with I = I. 

Proof: Implication (i) — (ii) i rneans that Property (i) implies Property 
(ii)). If (i) holds then, putting 7 = J = J, we can assert that there are parti- 
tions R1 and R» such that J—¢/2<Sp, and Sr, —1-- 2/2. Then for R = Rit Re 
we have . 
I—e/2.<Sp, = Sg = Sg = Sg, = I+ 2/2 
whence follows (ii). 

Implication (ii) — (i). Let R be a partition for which (1) is fulfilled: Then, -- 
by virtue of the inequalities Sg = J = I = Sp we have 1—1 < s. Now, since 
€ > O can be arbitrarily small and J and 7 are definite numbers independent 
of e, we conclude that J = J, i.e. (1) holds. 

Implication (iv) > (iii). Let integral (2) exist. From the definition of the 
integral it follows that, given any £ > O, thereis 6 > Osuch that for any par- 
tition R with 4x, < 6, irrespective of the choice of the points £j € [xj, xj41], 
hold the inequalities 


I-e/2 < "y f) Mx; < I 8/2 
1 


n-1 
Now, taking the supremum and the infimum of the sum Y. f(5;) Ax; over 
1 


2» 
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all £j € [x;, xj+1] entering into these inequalities we obtain 
I—e[2 = Sg Sg «I--e[2 (3) 


that is (3) takes place. 

Implication (iii) — (ii). The proof is quite obvious. 

Implication (ii) — (iii). This is the most intricate part of the theorem. We 
have to prove that if for any £ > 0 there isa partition R, = (a = xs < x1— 
<... < X, = b) dependent on e such that Sg, — Sa, < £, then there is 
6 > 0 such that (1) holds for all partitions R with Ax; < 6. 

To prove this part of the theorem let us take as 6 > 0 the number satis- 
fying the inequalities 20 < xj,1—x; (j = 0, 1, ..., n- 1) and 4n 6K < e 
where K — sup | f(x)|. Then we have 

x€la, b] 


Sa—Sga = ),/(M—m) Ax-- Y (OM — m) Ax 


(for brevity we omit the index j and write M, mand Ax instead of M;, m, and 
Ax;) where the sum } extends overall (closed) subintervals of the partition R 
such that each of them contains one of the points entering in R, and Y" 
extends over all the other subintervals of R. 

The sum >” involves not more than 2n summands: it includes one subinter- 
val containing the point a and one subinterval containing the point 6, and 
each of the points x,. . ., x, 11s contained in one or two subintervals. Thus, 
we have 


Y(M — m) Ax « 2K 82n < € 
Let us represent ?'"' as the two-fold sum 3" = Y' ?'! where /! denotes the 
f 


sum of the terms entering into Y" which correspond to those subintervals of 
R each of which is contained in exactly one subinterval [x?, x7,1] of the 
former partition R,- 

We have 


L (M-m) dx = Y" Y(M—m) dx = Y (Mf m; Ax = 
= L (M-m?) Ax? ee 


Therefore Sp—Sp < 2e for all partitions R with Ax < 6, that is (iii) holds. 

Implication (iii) — (iv). Let (iii) hold. Then, as has already been proved, (i) 
also holds. Let us choose an arbitrary e > 0 and find ô > 0 as was indicated 
in (iii). Then for the partition R mentioned in (iii) we obtain 


Sr =} f(&) Ax = Sr Sreal=1<Sp 
whence, putting J = I = I, we derive 
I-E (5) Axjl < e 


which means that Tis the definite integral of f on [a, b]. Thus, we have proved 
(iv). 
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The proof of the theorem has been completed. 
As a Consequence of the key theorem we obtain 


Theorem 2. Let there be a sequence of partitions Ry of the form 
a= x$ axie... x =b (k = 1,2,...) 


for which max Axf = ôk > 0. 


If the function f satisfies at least one of the conditions 


Jim (Sa) S8) = 0 (4) 
lim PIED Ak = lim SU) = 1 (5) 

and 
Jim Sa) = lim Sa) = 7 (6) 


b : 
then the integral I = f f(x) dx exists. 


Conversely, the existence of the integral of f on [a, b] implies the fulfilment 
of all conditions (4)-(6). 

From (4) (and also from (6)) obviously follows property (ii) mentioned in 
the formulation of the key theorem. Further (5) implies that for any € > 0 
there is k such that 

I—5s[2 < Sg, < Ir e[2 (8) 


for any & € bs xi]. Taking the supremum and the infimum of Sr, over 
the indicated £f^s we receive 


I—e/2 = Sr, = Sg, = IH e[2 (9) 


whence follows property (ii) of the key theorem by virtue of which there exists 
the integral of f on [a, b] which is obviously equal to 7. 

Conversely, if the integral exists and is equal to J then, by its definition, 
limit (5) exists for any sequence of partitions with 6, — 0, and, in particular, 
for the sequence in question as well. Therefore, given any s > 0, there is ko 
such that for k > ko there hold inequalities (8) and, consequently, inequali- 
ties (9) as well; hence (6) and, moreover, (4) take place. 

The theorem has been proved. 

Theorem 2 shows that in order to check the existence of the integral it is suf- 
ficient to verify that limit (5) exists (for any choice of E) for at least one of the 
sequences of partitions Ry with òx — O, for instance for the partition obtained by 
splitting [a, b] into n equal parts (n + œ). 


Remark. Darboux proved a theorem (whose proof we do not present 
here) asserting that 
lim SR =J and lim SR = I (10) 


$--0 0—0 
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for any bounded function f defined on [a, b] although this function may not 
be integrable (i.e. it may happen that J < J). 


Example. For the Dirichlet function f defined on [0, 1] which is equal to 

1 at the rational points of the interval [0, 1] and to 0 at the irrational points 
we have the equality Sp = 1 for the upper Darboux sum and Sz = 0 for 
the lower sum for any partition R of the interval [0, 1]. Hence, Z = 0 < 1 = 
= I, which means that the Dirichlet function, although bounded, is not 
Riemann integrable. 


§ 9.5. Existence Theorem for the Integral 
of a Continuous Function on an Interval (a, b]. 
integrability of a Monotone Function 


Theorem 1. If a function f is continuous on a closed interval [a, b] it is in- 
tegrable on that interval. 

Proof. Let f be continuous on [a, b]; then for any partition R whose sub- 
intervals satisfy the inequality Ax; < 6 we have 


n—1l n— 
Y. LE-A 4x; = F o0) Axy = 0(8) 0b—4) 
jo 


j20 


where o(9) = P a S')—S(%")| is the modulus of continuity of f on 


ad E Te | 
[a, b]. Therefore 
Sa— = sup Y [/6) —/()] 4x; = wò) (b— a) 
Êj 9j j=0 


As we know, the modulus of continuity (8) of the continuous function 
f defined on the closed interval [a, b] tends to zero as  — 0, and hence, given’ 
any £ > 0, there is ô > O such that $5— S4 < c. 

By the equivalence of properties (ii) and (iv) (see the key theorem), we 
conclude that the integral of on (a, b] exists. — ^ ooo oo 


Theorem 2. A monotone bounded function f defined on a closed interval 
[a, b] is integrable on it. 

For definiteness, let f be a nondecreasing function. Then, given an arbi- 
trary partition R with dx; = 6, we have 


"y UG) — f 4y « Y UGG) 4x; < 
j=0 j=0 
- » VD- = 8/(G)-/(] - e En y € [xp xi 
e 0 


provided that 6 > 0 is sufficiently small. Whence, taking the supremum over 
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‘D 





5. fand qj, we obtain 


Sa—Sg = sup $ SAEN- N Ax; < € 
and therefore, by the equivalence of properties (ii) and (iv), we conclude that 
the function f is integrable on (a, b]. 
It should be stressed that a monotone function f on fa, b] can only have 
a finite or a countable number of points of discontinuity. 
Indeed, let a = x1 < x2 <... < xy =b be some (not necessarily all) 
oints of discontinuity (of the first kind) of a monotone function / (x) defined 
on [a, b] (as above, we suppose that fis nondecreasing). Let us take £ > 0 
so small that 
d NLHE < X5— E < Note — X4—€8€ — ... 
Then 
N 
Y, Uf Gu e)— fo — €) = f(b)-S(a) = x 
k=1 
(if xı = a then we put f(a—e) = f(a) and if xy = b then we put f(b + €) = 
= {(b)). On passing to the limit as € — 0 we obtain 


S UG) fox 0)] < x 
k=1 


(if xı = a then x,—0 = a and if xy = b then xy+0 = b). This inequality 
shows that the function f can have not more than one point of discontinuity 
-with a jump exceeding ~/2. If there is such a point we supply it with the index 1 
and then check whether there are points of discontinuity with jump exceeding 
x/3. There can be not more than two points of this kind; if among the remain- 
ing points there is one or two points of the indicated type we supply them 
with the subsequent indices and so on. As the result of this procedure, all the 
points of discontinuity receive natural indices, which proves the assertion. 


9.6. Lebesgue's* Theorem 
8 gu 


`- closed interval [a, b] is Riemann integrable on that interval. We also proved 
that every monotone (bounded) function on [a, b] is integrable on [a, b]. 
.À monotone function may be discontinuous, and, as was shown, the num- 
ber of its points of discontinuity is finite or countable. There arises the 
natural question as to how many points of discontinuity a function may 
have to remain Riemann integrable. The exhaustive answer to the question 
is given by the following theorem. 


;' Theorem (Lebesgue). For a function f to be (Riemann) integrable on a 
=: (finite) closed interval [a, b] it is necessary and sufficient that it be bounded on 


* H. L. Lebesgue (1875-1941), a noted French mathematician, one of the creators of 


2x. the modern theory of functions of a real variable. 
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[a, b] and continuous on (a, b] everywhere except possibly on a set of Lebesgue 
measure zero. 

The proof of the theorem will be given in § 12.10 for the general case of an 
arbitrary dimension n. 

By definition, a set e has Lebesgue measure zero if, given any £ > 0, there 
is a finite or countable system of open intervals covering e such that the sum of 
the lengths of the intervals is less than €. 

A finite or a countable set e is always of Lebesgue measure zero. Indeed, 
let us number the points of the set e as x1, x», ... Each of the points can be 
covered by an interval of length less than «/2", the sum of the lengths of the 
intervals being less than e. 

Thus, it follows from Lebesgue’s theorem that every bounded function on 
[a, b] with a finite or countable number of points of discontinuity is Riemann 
integrable. 

It should be mentioned that among the sets of Lebesgue measure zero there 
are also uncountable sets. 


Example. Let us divide the closed interval [0, 1] into three equal parts 
and delete from [0, 1] the middle (open) interval (1/3, 2/3) (which is an open 
set); each of the remaining closed intervals [0, 1/3] and [2/3, 1] we again di- 
vide into three equal parts and remove the corresponding open middle inter- 
vals. On the remaining four closed intervals we again perform the analogous 
operations and so on. Continuing this process indefinitely we arrive at a 
subset E of the original interval [0, 1] obtained by deleting from [0, 1] a 
countable number of open intervals the sum of whose lengths is equal to 
1/34-2/9 - 4/21 4- ... = 1. The set E is closed. 

It can be proved (e.g. see P. S. Alexandrov, A. N. Kolmogorov, An Intro- 
duction to the Theory of Functions of a Real Variable, GTTI, 3rd ed., Moscow, 
1938) that the set E possesses the following properties: it is not only closed 
but also perfect, which means that every point of E is its limit point, it is 
nowhere dense in [0, 1], i.e. any open interval belonging to [0, 1] contains 
points not belonging to E, and finally, it is uncountable and at the same titne 
its Lebesgue measure (see $ 19.1, Vol. 2) is equal to zero. The set E is referred 
to as the Cantor* set. 

Let us consider the function 


1 for xcE 


x)= 
Fo) lo for x€ [0, 1]-E 

It is obviously continuous at all the points belonging to [0, 1]—£ and dis- 
continuous at all the points of E. Thus, f can serve as an example of a Rie- 
mann integrable function with an uncountable set of points of discontinuity. 


* After G. Cantor (1845-1918), a famous German mathematician, one of the creator: 
of modern set theory. 
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§ 9.7. Additivity and Homogeneity of the Integral 


Theorem 1. Jf a function f is integrable on [a, b] and if a < c < b then f is 
also integrable on [a, c] and on [c, b] and vice versa. In this case 


b e b 
JF) dx = | fa) dx+ | F) dx (a) 


Proof. Let us take an arbitrary sequence of partitions Rx, [a, b] containing 
the point c as a point of division, with the maximum subinterval tending to 
zero. Ry generates the corresponding partitions R; and Rg of [a, c] and 
[c, b], respectively, and 


Sr Sn, = (Sri SDH (Sn — Sry) (2) 


If the integral of f on [a, b] exists then, by virtue of the theorem proved in 
§ 9.4, the left-hand side of equality (2) tends to zero as k — œ and conse- 
quently each of the (nonnegative) summands on its right-hand side also tends 
to zero; by the same theorem, this implies the existence of the integrals of f 
on [a, c] and on (c, b]. Therefore, on passing to the limit as k — œ in the 
obvious equality 


Sg, = Sg, Sn; 


we obtain equality (1). 

Conversely, if the integrals of f on [a, c] and. on [c, b] exist then, for arbi- 
trary partitions Ry, and Ry corresponding to them whose maximum subinter- 
vals tend to zero, each of the differences on the right-hand side of (2) tends 
to zero as k +o and therefore the left-hand side of (2) tends to zero as well; 
this implies the existence of the integral of f on [a, b]. 

The integral of f on [a, b] was defined for the case a < b. It is convenient 
to extend this definition to the case a — b by putting 


b a à a 
[IŒ dx =—[ f(x) dx for a > b and IE dx = 0 (for a = b) 
a b a 


b 
As can readily be checked, in this generalized interpretation of the symbol [ 


a 
equality (1) continues to hold for any a, b and c provided that the integral 
over the greatest of the intervals [a, 5], [a, c] and [b, c] exists. Here by an 
interval [a, b] is meant the (directed) line segment connecting the point a to 
the point b, and [a, a] is understood as the point a. 


Theorem 2. Let f(x) and g(x) be two functions integrable on [a, b] and C bea 
constant, then the functions 


(i) f(x) Ee), (i) Cf G9), Gii) | fo), Qv) f G5) PC) and (v) I/F Ce) 


(where in the last case it is supposed that | {(x)| > d — O0 on [a, b]) are inte- 
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grable on [a, b], 


b b b 
J (693969) dx = f C2 dx x | p0) dx (2) 
and a a a 


b b 
f Cf(x) dx = C f f(x) dx (3) 


The integrability of the indicated functions is implied directly by Lebesgue’s 
theorem because the Lebesgue measure of the sum of two sets of Lebesgue 
measure zero is again a set of measure zero, but it is also possible to prove 
the theorem without resorting to Lebesgue’s theorem. 


Let us take an arbitrary partition a = xo < X1 <... <x, = b. Then 
lim 2 IAE) x 9(5))] 4x; = lim bf (£j) 4x; tim 296A. dx; = 
max xy 
= f f(x) dx+ j (x) dx 


because, by the hypothesis, the integrals of f(x) and p(x) exist. Consequently, 
the limit on the left-hand side of these relations exists and is equal to that on 
the right-hand side. This means that (2) holds. Similarly, 


b 


b 
f Cfdx = lim Cf ax; = Clim ZSE) 4x = C | f dx 
2 max 4x7 


a 


We have proved properties (i), (ii) and equalities (2) and (3). 
Let us denote Mp = sup fand m= vu T. The numbers My 
X € (xy, Xy41l 
and my depend of course on j but we omit the index, j jTor the sake of brevity. 


Let us also put Kr — sup |f|. For arbitrary $, 7 € [xy, xj«1] we have 
x € [a, b) 


IAEI SAI = LSE- = Mj— mr 
SEE- Mpm) =E 19()—9(014- 
+ 190011 /()—/Q)| = Ki(M,— m) + K,(My— my) 
and 


1 1 _ f@-fM liu. 
J6 fe^ fef 40r m 


On taking the suprema of the left-hand sides of these equalities over 5,9 € 
€ [x xj4 1]; multiplying them by dx; and summing with respect to j we re- 
ceive 

EMi ms) Ax <= Y (My— m) Ax (4) 
Y (Mg, — mg) Ax = Kr Y, (M,— m,) Ax+ K, Y, (My— my) Ax (5) 
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and 
Y (Muy muy) dx = -+ Y (Mj my) Ax (6 


(here we have omitted the index j in Z1xj). By the integrability of f, the right- 
hand sides of (4) and (6) can be made less than € > O for an appropriate 
choice of the partition and then the left-hand sides also become less than e. 
In the case of relation (5) the argument is slightly more complicated: for any 

given & > 0 we find partitions Ri and R» for which, respectively, 


Sa )-Sm() <e and Sa(g)—Sa,(g) < € 


Therefore, moreover, both Ri and R: can be replaced by R = R,-- Rs. 
If we consider relation (5) for that very partition R it can be rewritten as 


SrUP)— Sn fp) = (Kr Kee (7) 


Thus, there is a partition (the partition R) for which the left-hand side of (7) 
becomes arbitrarily small, whence follows that fp is integrable on [a, b]. 

Note that the integrability of | f(x)| does not imply that of J (x), which 
is readily confirmed by the example of the function equal to 1 at the rational 
points of [a, b] and to —1 at the irrational points. 


§ 9.8. Integrating Inequalities. Mean Value Theorem 


Theorem 1. If functions f and ọ are integrable on a closed interval [a, b] and 
satisfy the inequality f (x) = p(x) on that interval then 


b b 
[f dx {pdx (1) 


By the hypothesis, both integrals in (1) exist, and it only remains to prove 
the inequality itself. For any partition R we obviously have 


LSE) 4x « Lp) 4x, 
On passing to the limit as max Ax; — 0 we arrive at (1). 


Theorem 2. If f is integrable on [a, b] then 
b 


[£x 
| 


where K = ‘Sup F(x) |. 


We have zi "i (x)| = f(x) = |f(x)| and therefore the foregoing theorem 
shows that 





b 
f I/I dx = Kb—2) (2) 





b b b b 
- fifidx = [(-Wi)dx = [fdx< f ifiax 
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whence follows the first inequality (2). Further, we have |f| = K and there- 
fore 
b b 


[fide = f Kdx = Ktb-a) 


which gives the second inequality (2). 
In Theorem 2 we meant that a < b. If a > b then 


= | fas 


b 


je 








= fun dx « (a—b) K = K|b—a| 
b 





Theorem 3 (Mean Value Theorem*). If f and 9 are integrable on [a, b] and 
(x) = 0 then 


b b 
[fedx =A | pax (3) 
wherem=A<M,m= inf f(x)andM= sup f(x) 
asxsb azxsb 


Indeed, since p(x) = 0 we have 
mg(x) = f(x) p(x) = Mg(x) (4) 
‘On integrating these inequalities we obtain 


b b b 
m [odx« [fodx M | pdx (5) 


b 
if IE dx = 0 the second integral in these relations is also equal to zero, 


and equality (3) becomes obvious; if f p dx > 0 then (5) implies 


b 
| fees 
^d 
[o4 


m «es sM 


that is the second term in the above relations is equal to a number A satis- 
fying the inequalities m = A = M, which is what we had to prove. 


* This theorem is also called the first mean value theorem (on the second mean value 
theorem see§ 9.10). — Tr. 
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Corollary. If the function f in Theorem 3 is continuous on (a, b] then there 
are points xi, xo € [a, b] such that f(x») = M and f(xi) = m and also a 
point E € [x1, x2] such that f (5) = A; consequently in the case of a continuous 
function f defined on [a, b) equality (3) can be written in the form 


b b 
[Sods =s® [o dx (a «E <b) (6) 


Theorem 4. If f is an integrable nonnegative function on [a, b], xo € [a, b] is 
a point of continuity of f and f (xo) > 0 then 
b 


| fax - 0 


a 


Indeed, the conditions of the theorem imply that there is a number 
4 > O and a closed interval o c [a, b] containing xo such that f(x) = 4 on o. 


Let ô denote the closure of the sët [a, b]— c: 6 = [a, »]— o (it consists of one 
or two closed intervals). Then 


[eT [fax = J fax el -0 
a p 3 


g 


where |o| denotes the length of the interval c. 


§ 9.9. Integral as Function of Its Upper Limit. 
Newton-Leibniz Theorem 


Let f be an integrable function defined on a closed interval [a, b]. it should 
be noted that 


b b 
fs (x) dx = f f(u) du 


b 
This means that the value of the definite integral f f(x)dx does not depend 


a 
on the notation of the variable of integration, that is its value does not de- 
pend on the letter (x, u and the like) written under the sign of f in the definite 
integral of f over the interval [a, b]. Such a variable (in this case the variable 
of integration x) is said to be dummy. 
Let us take an arbitrary value x € [a, b] and take the new function F(x) — 


= I f (t) dt. It is defined for all the values of x belonging to (a, b] because, as 


a 
is known, if the integral of f on [a, b] exists then the integral of f on [a, x] 
also exists for any x satisfying the relation a « x < b. We remind the reader 
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that, bv definition, 
F(a) = f fdt=0 (1) 


and also note that 
b 
F(b) = | f(t 
a 


Let us show that the function F is continuous on [a, b]. Indeed, if xc 
€ [a, b] and x+h € [a, b] then 


x+h x x+h 


F(c+h)— F(X) = f f(t) d— i fÀ dt = f f(t) dt 
and, denoting K = sup |/()| (a = t = b), we obtain 
xh 


] 
HFG-Hi)- FG9L | f SO dt| = K |A +0  (h=0) 
|x i 


Hence, F is continuous on [a, b], irrespective of whether or not the inte- 
grand / has discontinuities, provided that fis integrable on [a, b]. 

Fig. 9.1 shows the graph of f. The area of the variable figure aABx is 
equal to F(x). Its increment F(x+h)—F (x) isequal to the area of the 
figure xBC(x+h) which, by the bo- 
undedness of f, obviously tends to 
zero ash — 0 irrespective of whether 
x is a point of continuity or a point 
of discontinuity of f ; for instance, 
this increment tends to zero for the 
point x = d which is a point of dis- 
continuity of f. 

Now let us suppose that the func-. 
tion f is not only integrable on [a, b] 
but also continuous at a point x € 
€ [a, b]. We shall show that in this case 
F has a derivative at the point x equal 


Fig. 9.1 to f (x): 
F'(x) = f(x) (2) 


Indeed, for that point x we have (see the explanations below) 


Y 


! 
5 
i 
i 
| 
| 





xh x+h 

Fix h) F(X) 1 l 

Sua jf04-4[ Od = 
ou ih 


7 F f Sœ d+ f H(t) dt = f(x)+0(1) (h-0) (3) 
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Here we have put f () = f(x)+7(); since f(x) as function of the variable ¢ 
x+h 
is a constant, we have f f(x) dt 2 f(x)h. Further, by the continuity of f 


at the point x, for any e > O there is ô > 0 such that jn(2)| < for all £ 
satisfying the inequality |x— t| < 6. Therefore 

( xh 

iz f xdi eee e€ for|h| <6 

| h lhl 


x | 


which shows that the left-hand member of this inequality is o(1) as ^ — 0. 
The passage to the limit in (3) as h -- 0 shows that the derivative of F at 
the point x does exist and that equality (2) takes place. In the cases x — a 
and x — b we must of course speak of the right-hand and the left-hand 
derivative of F respectively. 
If f is a continuous function on [a, b], then what has been proved shows 
that the corresponding function 
x 
F(x) = | sat (4) 


a 


has a derivative at each point x € [a, b] equal to f(x): F'(x) = f(x) for 
a= X = b. Consequently, in this case the function F(x) is an antiderivative 
of f on [a, 5]. 

We have thus proved that every function f defined and continuous on a 
closed interval [a, b] has an antiderivative on that interval given by equality 
(4). This shows that, as was mentioned (see § 8.1), every function continuous 
on a closed interval possesses an antiderivative on that interval. 

Let (x) be an arbitrary antiderivative of the function /(x) on [a, b]. We 
know that ®(x) = F(x)+C where C is a constant. On putting x = a in this 
equality and taking into account that F(a) = 0 we get ®(a) = C. Conse- 
quently, F(x) = ®(x)—@(a). But we have 


$e, 2 
fA dx = FO) 
and therefore i 


b 
[109 dx = 80) (9) = 8G» [7 ©) 


a 
We have proved the following important theorem: 


Theorem 1 (Newton-Leibniz). [ff is a continuous function on a closed inter- 
val [a, b] and © is its arbitrary antiderivative on that interval then there holds 
equality (5). 
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By Lagrange’s theorem on finite increments, it follows from (5) that 
b 
fA dx = f&)(6-à) — (@<é <0) 
a 


where € is a point belonging to (a, b). We thus obtain a more precise relation 
than equality (6) in§ 9.8 taken for p(x) = 1 which only asserts that & c [a, b]. 
Theorem 1 admits of the following generalization: 


Theorem 2. If F(x) is a continuous piecewise smooth function on [a, b] then 


b 
F(b) — F(a) = Í F(x) dx (6) 


Proof. Let us take the partition 


a=xo<x<...<x%,=b 


where xi, . . ., X4-1 are the points of discontinuity (of the first kind!) of the 
derivative F'(x) (see§ 5.15). Then we have (see the ana below) 
nel xjdi 
F(b)— F(a) = b [FGu«:)— FG] = > J F(x) dx = j F(x) dx (1) 


a 


The second equality in (7) holds because we D 
Xja 
F(xj41)— Fy) = f F) dx (8) 
x; 
for any j, for the derivative F'(x) exists and is continuous in the open interval 
(xj, Xj+1) and besides, the limits F'(x, 4-0) and F'(x;,.1— 0) are sure to exist 
and are equal to the right-hand derivative of F at the point x — aandto the 
left-hand derivative of F at x — b respectively. 
The integrability of F’ on each of the closed intervals [x;, xj1] implies its 
integrability on [a, b] and the last equality (7). 


Remark. The fact that the function F' is not defined at the points xı, . 
. »Xn-1€ [a, b] does not violate its integrability on [a, b] (this question is 
discussed in more detail in $ 9.11). 


Theorem 3 (on Integration by Parts). For continuous piecewise smooth 
functions u(x) and v(x) defined on (a, b] the formula of integration by parts takes 
place: 


b b 
fue v(x) dx = u(x) v(x) L- I u(x) v'(x) dx (9) 


Indeed, the product u(x)v(x) is also a continuous piecewise smooth func- 
tion on [a, b] and thus it has a derivative everywhere on fa, b] except possibly 
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at finite number of points, the derivative being given by the formula 
(u(x) vG))' = u(x) o'(x)+-u'(x) v(x) 
Taking into account that the functions w(x) v(x) and u(x) v'(x) are also in- 
tegrable on [a, b] we see that, by the foregoing theorem, 
"E. b 
u(x e|; = f u'(x) o(x) dx+ | u(x) v'(x) dx 
a a 


whence follows (9). 


Theorem 4 (on Integration by Change of Variable). Jf a function x = o(t) 
is continuously differentiable on (c, d], a = p(c), b = q(d) and the values o(t) 
(c = t = d) of the function p belong to an interval [A, B] of continuity of a 
function f (x) defined on (a, b] (i.e. [a, b] c [A, B]) then 


b d 
J £6) ax = f Mole at (10) 


Indeed, let F(x) and P(A be some antiderivatives of the functions f(x} and 
Jip e'(t) respectively. Then (see § 8.1 (2)) we have the identity (f) = 
= F[g()]- C, c = t = d, where C is a constant. 

We now see that, by the Newton-Leibniz theorem, (10) follows from the 
obvious equality 


P(d)—P(c) = F(b)— F(a) 
Example 1. According to the Newton-Leibniz theorem, we have 


v a é é . . 
f sin x dx =—cos x LS 2 because the function sin x is continuous on 
| i 


0 “« . 
[0, x] and —cos x is its antiderivative. 


` Example 2. By Theorem 2, we have 
b 


f sens de = in he ibl- lal (11) 


since |x| is a continuous piecewise smooth function on the closed interval 
[a, b] (or even a smooth function if ab = 0) and sgn x is its derivative exist- 
ing everywhere on [a, b] except at the point x = O (provided the latter be- 
longs to [a, b]). 
In particular (11) implies 

x 

f sen t dt = |x| 

0 
20006—24 
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§ 9.10. Second Mean Value Theorem" 


Theorem. If a function is nonnegative and nondecreasing on a closed inter- 
val [a, b] and a function f is integrable on [a, b] there exists a point € € [a, b] 
such that 


b b 
[ 969/69 dx = 9t) [ S) dx (1) 
a Ei 


Proof. Let us first consider the special case when ọ has the continuous 
derivative p’ on [a, b]. Integrating by parts we receive 


b b b b 
J 969/69 dx = —e9 f feo dui’ | G2 f SG) du dx = 


b b b 
= g(a) { f) dur | g'(x) [.fG) du dx (2) 
Let 
b b 
m= min ,]/0 du and M = max ax | s6) du 


then the right-hand side of (2) is not greater than dud g(x) dee = 


b 
= q(b)M, since g(a), q'(x) = 0, and not less than (ro f g'(x) 2 m= 


a 
= g(b)m. Consequently there is & c [a, b] for which equality (1) holds. 
If p is a nondecreasing nonnegative function, generally speaking, dis- 
continuous, then it is integrable on (a, b], and there is a sequence of continu- 
ously differentiable nondecreasing onnegatuve functions y,(x) for which (see 
§ 18.2 and 18.5, Vol. d 


j leG)—wCOl dx - 0, n> G) 


By what has already been proved, for any n there isa point £, € [a, b] such 
that 
b 


b 
J ASO) dx = 90) | Se) dx (4) 
a £n 


a This theorem is also known as Bonnet’s theorem. P. O. Bonnet (1819-1892), a French 
mathematician. — Tr. 
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The sequence (5,) contains a subsequence convergent to a point £ € [a, b]. 
Consequently, since the integral on the left-hand side as function of the 
lower limit £, is continuous from the right and since 


b 


b b 
« K [ Iv. 9l dx — 0, n =œ, K =| f(x) 


f Prf dx -| pf dx 


a 








we obtain (1) from (4) on passing to the limit as n — co in the latter. 


§ 9.11. Modification of Integrand Function 


Theorem. Zf the values of an integrable function on [a, b] are changed at a 
finite number of points belonging to that interval the new (modified) function is 
integrable and the value of the integral remains unchanged. 

Proof. Yt is clear that the new function is representable in the form 


f(x) = f(x) o) 


where ¢ is equal to zero everywhere on [a, b] except at the points mentioned 
in the statement of the theorem. It is also clear that y is integrable and that 
the integral of ọ over [a, b] is equal to zero. Therefore f; is integrable and 


b b b b 
[dx = | fax [Jo dx= | fax 


Up till now, when speaking of an integrable function f on [a, b], we sup- 
posed that f was defined throughout [a, b]. The theorem proved above 
shows that the integrability of f does not depend on the values which f 
assumes at a finite system of points of the interval [a, b). Therefore it is al- 
lowableto suppose that f is not defined at those points at all. In this sense we 
can speak of the integrability of a bounded function f on [a, b] which is in 
fact defined on the set obtained from [a, b] by deleting a finite number of 
points; in this very sense we can speak of the integrability of sin or of 
M on the interval [0, 1]. Both functions are only defined in the half-open 
interval (0, 1] where they are bounded and continuous but we can say that 
they are integrable on [0, 1]. 

If a function f defined and integrable on an interval [a, b] is redefined on a 
countable set of points, the modified function f; may be nonintegrable on 
[a,b]. For instance, the function f(x) = 1 is Riemann integrable on [0, 1], its 
integral being equal to 1 (its any integral sum is equal to 1). But if we re- 
place its values at the rational points by zero the new function fı is the 
Dirichlet function which is not Riemann integrable: its any upper Darboux 
sum is equal to 1 while any lower Darboux sum is equal to 0. But this is not 
always the case. 


24° 


372 A COURSE OF MATHEMATICAL ANALYSIS 


Let e be the set on which a given function f (which is supposed to be 
integrable on [a, b]) is redefined and let fı denote the new (modified) func- 
tion. Then f(x) = fi(x)4- g(x) where p(x) = Oon [a, b]—e. If the set e is such 
that the integral over [a, b) of any such function 9 (i.e. of any function which 
is bounded on [a, b] and assumes zero values on (a, b]—e) exists and is 


equal to zero IL dx = 0} then the function f can obviously be arbitrarily 


redefined on e without violating its integrability and changing the value of the 

integral. In such a case we can speak of the integral of the function f irres- 

pective of whether or not it is in fact defined on e. We then say that the in- 
b 


tegral f f(x) dx taken over the interval [a, b] exists although the function f 
Itself may only be defined on [a, b]— e. 


Example. The function y(x) — sin (sin i) -1 is defined on [0, 1] — e where e 
is the set consisting of the point 0 and of the points x, = n (k=1, 2, ...); 


this set is obviously countable. If we extend y to e by pilne it equal to any 
numbers at these points on condition that these (new) values form a bounded 
set the resultant function y,(x) is defined throughout the interval [0,1] and 
is integrable on it because it is bounded on [0,1] and continuous everywhere 
on [0, 1] except at the points of the set e of Lebesgue measure zero. 

The integrability of y is also implied by the following theorem. 


Theorem. A function f bounded on [a, b] and integrable on any closed in- 
terval [a, x] where a < x < b is integrable on [a, b]. 

The same assertion holds if [a, x] is replaced by [x, b]. 

Proof. Let us choose an arbitrary e > 0. Let | /(x)| =M on [a, b] and 


ô= dM "Z . Since fis integrable on the interval [a, b— ô] there exists a partition 


R' of this interval (R' = (a = xo < x1 <... < Xn-1 = b— ô} such that 


n-2 
Sr—Sw = Y (Mj-m) Ax; <> 


j=0 


Let us also take the partition R = (a = xo < x1 <<... < Xn-1 = Xn = b} 
of the interval [a, b]. Then 


Se—Sp=(Se—Se)+(Mn—-1—my-1)8 < $ +2M6 =e 


which shows (see § 9.4, the key theorem) that fis integrable on [a, b]. 

In the above example the function p is bounded on [0, 1] and integrable 
on any closed interval [6, 1] with 6 > 0. For there are not more than a finite: 
number of points of discontinuity of the function «y on [6, 1]. 
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§ 9.12. Improper Integrals 


Let a function f be defined in a half-open finite interval [a, b). We shall 
suppose that it is integrable on any closed interval [a, b’] with b' < b and is 
unbounded in a neighbourhood of the point b. Then the ordinary (Rie- 
mann) integral of f on [a, b) or, which is the same, on [a, 5] cannot exist 
since a Riemann integrable (in the proper sense) function on [a, b] must be 

m 


bounded. But it may happen that the limit lim f f(x) dx exists. If it does 
b'-—b 


exist we call it the improper integral of f on the interval [a, b] and write 


b p 
Í f(x) dx = lim f f(x) dx (1) 
a Eb a 


b 
In such a case we say that the (improper) integral f f dx exists or that it 


a 
is convergent. If otherwise, i.e. if this limit does not exist, we say that the in- 
tegral is divergent or, synonymously, that it does not exist (in the sense of an 
improper Riemann integral). 
Now let us suppose that a function f is defined in a semi-infinite interval 
[a, ~) and is integrable on every finite closed interval [a, b'] where a < b' < 
<æ, Then if the limit 


" 
lim I f (9) dx 
b—o à 


exists we call it the improper integral of f on [a, œ) and write 
p 


J £69 dx = lim [ fŒ) dx 
a fete a 
We shall use the following terminology. A (formal) expression 
b 
[fed (2) 


will be referred to as the integral (of f) with only one singularity at the point b 
if the following conditions hold: if b is a finite point then the function / is 
integrable on [a, b'] for any b' satisfying the inequalities a < b' < b and is 
unbounded in a neighbourhood of the point b; if b = + it is only re- 
quired that the function f should be integrable on [a, b'] for any finite b' — a. 


An integral of the form f f(x) dx with only one singularity at the point a 


a 
is understood in the same sense. In this case b is a finite point, and if the 
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point a (a < b) is also finite it is required that the function / should be un- 
bounded in a neighbourhood of the point a and integrable on every closed 
interval [a', b] where a < a’ < b; ifa = —æ the function fis only supposed 
to be integrable on [a', b] for any a’ < b. 

For definiteness, we shall deal with integral (2) with only one singular- 
ity at the point b which can be finite or infinite. By analogy with this case, 
all the conclusions can readily be extended to the case of integral (2) with 
only one singularity at the point a. 


Theorem. Let there be given an integral of type (2) with only one singularity 
at the point b. For the existence of the integral it is necessary and sufficient that 
the conditions of Cauchy's criterion hold: given any € > Q, there is bo < b 
Such that 

p" 


| [ fat <e (3) 
r 





Jor any b' and b” satisfying the inequalities bo < b' < b” < b. 
Proof. Let us consider the function 


F(x) = j/o dt (a<x<b) 


The existence of integral (2) is equivalent to the existence of the limit 
lim F(x), which, in its turn, is equivalent to the conditions of Cauchy's 


xb 
x«b 
criterion for the existence of the limit of a function which reads: for any 


£ > O there is bo, a < bo < b, such that for all b’ and b” satisfying the in- 
equalities bo < b' < b" <b the inequality |F (b^) —F(b")| < e holds. But 


b". 
F(b")—F(b’) = [ ft) 
; 


and thus we see that the assertion of the theorem holds. 


Example 1. The integral 
1 
dx 
g (4) 
0 
where a > 0 is a constant number obviously has only one singularity at the 
point x = 0. To find whether the integral is convergent we must consider 
the corresponding limit: 
1 1 
lim [ @ = lim- L 
9 J X peo Ie xen} 
e>Q ° € 


I 
= lim LL [Le] = [cs for a «1 
e—0 





1- 
7 for « > 1 
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Thus, integral (4)is convergent for < 1 and is equal to (1—«)~ “in this case 
and is divergent for « — 1. 
For x = l itis also divergent: 


1 
lim & = —limine=+< 


ce—0 t0 
e 


eo 


Example 2. For the integral f ae we have 





xt 
1 
eo N 1 
dx dx 1 a lN |= fora > I 
J == lim {[2=;, im xl ie a-l 
i Nore.) Ne : +o forx-«1 


Hence, it is convergent for « > 1 and divergent fora < 1. 


The integra] J & (the case x = 1) is divergent: 
1 


N 
im [4 = lim nN=+o 
PHI 


N— œ 


vos 
"s 


Let us come back to the general expression of an integral 


b 
[rdx (5) 


having only one singularity at the point b. In this case the integral 


b 


f fdx (6) 
a 
where a < c « b also has only one singularity at the point b. It is obvious 
that the conditions of Cauchy's criterion for the existence of the integral 
are stated in exactly the same manner for both integrals (5) and (6). Con- 
sequently, these integrals are simultaneously convergent or divergent. For 
a < c < b we also have the obvious relation 


b v c b' 
fro = lim | fe = tin (f re] fs) - 
: 


Sja dx + lim [ies [rose | rs (7) 


376 A COURSE OF MATHEMATICAL ANALYSIS 


c b b 
where f is an ordinary (proper) Riemann integral while the integrals f and f 
a a € 


are improper. 
We also note that for di constants A and B me eauahty 
b b. 
| (A+B) dx = jim , fara dx =A lim Lj ras lim fe dx = 


- 4| TSi |od (8) 


takes place. It should be understood in the sense that if the integrals on the 
right-hand side exist then the integral on the left-hand side also exists and 
equality (8) holds. 

An integral of type (5) (with only one singularity at the point b) is said to 
be absolutely convergent if the de 


f ISOJI dx < æ (9) 


of the modulus of the function f(x) is convergent. 

Let us prove that an absolutely convergent integral is convergent. Suppose 
that integral (9) is convergent. Then, given any £ > 0, there is a point bo 
belonging to the open interval (a, b) such that the inequalities bo < b' < 
< b” < b imply 

2 


uel Lf C91 dx = E 








that is integral (5) satisfies the conditions "M Cauchy's criterion. 
Since 


b b' 
J fe) ax| = f ISi dx 








we conclude, on passing to the limit as b' — b, that for an absolutely con- 
vergent integral of type (5) the inequality 





b b 
J A) dx} = f If dx (10) 





is always fulfilled. 
A convergent improper integral may not be absolutely convergent* (see 


* A convergent improper integral which is not absolutely convergent is said to be 
conditionally convergent. — Tr. 
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the examples in §§ 9.14 and 9.15). But, of course, a convergent improper integ- 
ral of a nonnegative function is always absolutely convergent. 
The following theorem can be proved quite easily. 


Theorem. Zf a function F(x) is continuous on a closed interval! |a, b] and has 
the continuous derivative F'(x) on [a, b) then 


F(b)- F(a) = im. [F(b^) — F(a)] = jim Jro dx = jro dx 
pze p lb a 


where the integra! on the right-hand side may be proper or improper. 
For instance, we have 





Here the singularity is at the left end point of the interval [0, 1]. 


§ 9.13. Improper Integrals of Nonnegative Functions 


Let us consider the integral 
b 
if f(x) dx (1) 


with only one singularity at the point b, and let f(x) = 0 in the interval of 
integration [a, 5). 
In this case the function 


" 
eve ers "psit 


dependent on b’ is obviously monotone nondecreasing. Therefore, if it is 
bounded, i.e. if F(b') « M (a <b’ < b) for some M > 0, integral (1) is 
convergent (exists): 


b b 
f f(x) dx = lim f f(x) dx = M 
: b-b x 
If F is unbounded Piega (1) is divergent (does not exist): 
E 


[roa = lim uA ii dos 


(in such a case it is sometimes said that integral (1) is divergent to + œ). 
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If f(x) = 0 on [a, b) we write 
b 


b 
| f(x) dx <% or | fdx =% 
l l 


depending on whether the integral is convergent or divergent (to + œ). 


Theorem 1. Let each of the integrals 
b 
fax (1) 


and 
b 


Jo ax (2) 
have only one singularity at the point b and let the inequalities 
0 = f(x) = p(x) (3) 


be fulfilled in the interval [a, b). 
Then the convergence of integral (2) implies the convergence of integral (1) 
and the inequality 


b b 
f| £d = [o dx 


while the divergence of integral (1) implies the divergence of integral (2). 
Proof. Inequalities (3) imply that 


b b 
| fax = f p ax (4) 


fora < b' < b. If integral (2) is convergent the right member of (4) does not: 
exceed integral (2) and therefore the left member is also bounded above. 
Since the left member is monotone nondecreasing as b’ increases, it tends to 


b 
a limit which is equal to the integral J fdx: 
b v b 
dx = lim "dx x dx 
[fs im | piso jv 


Now, if integral (1) is divergent the limit of the left member of (4) as b’ — e» 
is equal to œ, and consequently the limit of the right member is also equal 
to «e. 
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Theorem 2. Let each of the integrals (1) and (2) have only one singularity at 
the point b, let the integrands be positive and the limit 


fe 
lino 479 (5) 
exist. 
Then the integrals are simultaneously convergent or divergent. 
Proof. It follows from (5) that for any positive e such that € < A there is 
c € [a, b) such that 


A— e < IU uae (c <x « b) 


p(x) 
and, since g(x) > 0, we have 
(4—6)9(x) < f(x) < (Ate) p(x) | (ce xb) (6) 


b 
The convergence of the integral Je dx implies the convergence of the 
b oe b 


integral f ọ dx and also the convergence of the integral f (A+ £)g dx. There- 
e c 

b 

fore, by virtue of the foregoing theorem, the integral f J dx albo converges 

and, together with it, so does the integral f fdx. Conversely, if | f dx is con- 

vergent then i 9 dx is also convergent because, together with (5), there holds 


the equality 
90) I 
lim Fay fx) A^ 


Remark 1. Theorem 2 admits of the following generalization. Let, as 
before, the functions f and 9 satisfy the conditions of Theorem 2 and let y 
be a continuous nonnegative function defined on (a, b). Then the integrals 
j Sy dx and for dx are simultaneously convergent or divergent. To prove 


this proposition one should make use of the inequalities 
(4— &) p(x) y(x) = f(x) y(x) = (A+) p(x) p(x) 
implied by (6). 


b 
Remark 2. If A = 0 in Theorem 2, the convergence of the integral f p dx 
b 


implies that of the integral f f dx, which follows from the second inequal- 


ity (6). 
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Remark 3. It is allowable to assume in the statement of Theorem 2 that 
only one of the functions f and ọ is positive on [a, b) because (6) shows that 
under this assumption the other function is positive on [c, b) for some c. 


Examples. Let us agree that the symbol ~ placed between two integrals 
means that they are simultaneously convergent or divergent. In the examples 
below, when writing ~, we resort to nun 2. 


@ fis" [zia j£-- 


1 1 


(ii) [ui^ irme "e 


Fto ) 0 


The singularities in integrals (i) and (ii) are only at the point x = 0. In 
the denominators in the integrands of these integrals we have written the prin- 
cipal power terms (see §§ 4.10 and 5.11) and thenapplied Theorem 2. Integral 
(i) is convergent while integral (ii) is divergent. 


(iii) Í x*e- ^P dx = f (x**2e-725) T dx = KÍ E < co (B > 0) 
1 1 1 


The function in the parentheses is continuous on [1, oo) and tends to zero 
for x + ©; therefore it is bounded above on [1, œ=) by a constant K. Con- 
sequently, this integral having only one singularity (at x = œ) is convergent. 


§ 9.14. Integration by Parts 


Let two continuous functions (x) and y(x) be defined in an interval [a, e») 
and, besides, let y be continuously differentiable. Denoting by (x) an arbit- 
rary antiderivative of p(x) we can write 


N N 
J 969 969 dx = v0) 9()— pla) $(2)— | vC) 90) dx, 


a<N<o (1) 
If the improper integral 


J v (9909 dx = 4 Q) 


exists and if the limit 
lim p(x) (x) = B (3) 
X— To 
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exists then the improper integral 


b 
f 969 p(x) dx = B-y(a) Dla) -A (4) 


also exists. 

Below we give two special sufficient tests for the existence of integral (2) 
and limit (3) and thus for the existence of integral (4). 

(i) Let the function ®(x) be bounded, i.e. 


(B(x) = M (5) 
and let the function p(x) tend to zero as x — e»: 
y(x)-—-0 (x +=) (6) 
Also, let 
f IOI dx << (1) 


then integral (2) and limit (3) exist. 
Indeed, under these conditions, integral (2) is convergent and even abso- 
lutely convergent because 


f lp (x) (x)| dx = MÍ lp (x)| dx < æ 


and we also have 
lyx) Bax) « Mly) +0 (x=) 


in this case. Consequently integral (4) converges and B = 0. 

(ii) Dirichlet’s test. This test requires that the function ® should satisfy 
inequality (5) and the function y should be decreasing on [a, »») and tend to 
zero as x — œ. As before, the function y is supposed to be continuously 
differentiable, and therefore the above requirement implies that its derivative 
is nonpositive. Condition (6) holds in this case, and condition (7) also holds 
because the limit 


N N 
Jim. J |v/G2| dx = — lim J y) de = lim fy(a)—v(N)] = va) 


exists. Consequently, Dirichlet’s test is a particular case of Test (i). 
Example. The only singularity of the integral 


sin x 
[Ae @) 
0 a 
is at the point x = e. One should take into account that the function T 
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has a removable discontinuity at the point x = 0. If we put the function equal 
to 1 at that point the (new) function will be continuous. Integral (8) con- 
verges because, by Dirichlet’s test, the integral 


sin x 
E 
x 

l 


converges since the function 1/x is monotone decreasing, tends to zero as x — 
— œ and has the continuous derivative —(x)~? while the function sin x is 
continuous and its antiderivative —cos x is bounded. It should be stressed 
that although integral (8) is convergent it is not absolutely convergent (see 
§ 9.15, Example 1); hence, it is conditionally convergent. 


§ 9.15. Relationship Between Improper Integrals 
and Series* 


Let us consider the integral 
b 
J 10) ax (1) 
with only one singularity at the point b. Let us take a sequence 
a= ba < bi <b, <...<b, bk >= b 


Together with integral (1) we shall consider the series 


f b, be bya 
f| faxt | fde+... = y J fdx (2) 
bo bi ke0p 
whose kth term is 
bisi 
u= | fdx 
J 


Theorem 1. If integral (1) converges so does series (2) and there holds the 
equality 
bias 


j fax = x J fdx (3) 


For we have 


beat baer 


ci fdx — lim zy fàs- | fas 


A= œw 


* In this section we usc some elementary notions of the theory of series (see § 11.1). 
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If f is nonnegative on fa, <) then, conversely, the convergence of series (2) 
implies the convergence of integral (1). Indeed, let the series be convergent 
and its sum be equal to S. Then for any b’ such that a < b' < b there is 
n = n(b^) such that b' < b,. Therefore, taking into account that f(x) = 0, 
we can write 


A M aml Past 
| fax= | fdx= ¥ | fdx «8S 
a a k=0 b, 


which means that the integral of the nonnegative function f on the left-hand 
side is bounded above and, consequently, improper integral (1) exists. There- 
fore, as was proved above, equality (3) is fulfilled. 

In the case when the function f does not retain sign on [a, b) the conver- 
gence of series (2) does not, generally, imply the convergence of the integral. 
For instance, the series 


5 Xk 4 1)3 


Y f sinxdx = y0-0 
k=0 2ka 0 


is convergent while the integral f sin ¢ dt is divergent because the integral 
0 


x 
[ sin t dt = 1—cos x 
0 


as function of x has no limit as x + œ. 


Theorem 2. If f is a continuous nonincreasing function on (0, œ) the integral 


f Se) dx (3) 


and the series 
Y f(9 = AOEDD ... (4) 
k=0 i 


are simultaneously convergent or divergent. 
Proof. We have the obvious inequalities 


kl 


Skta | daf — (01...) 
k 


On summing them with respect to k we obtain 
n+l 


Sih — Xf « | Sdra FS) 
1 0 o 0 
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Since all the terms in these relations are monotone nondecreasing as n 
increases, we arrive at the assertion of the theorem. 
From this theorem it follows that the series 


1+1/27+1/3*+ ... (5) 


is convergent for x > 1 and divergent for x <1 because the function 
1/(1-- x)* is monotone decreasing on [0, œ) for x > 0 and 


(de . [dx E : 
| dg 7 if x>J and [a7 if «<] 
0 


In the case x < 0 it is readily seen that series (5) diverges. 


Theorem 3. Let the functions p(x) and (x) entering into the integral 


f g(x) dx (6) 
0 


p(x) 
be continuous and let (x) be positive and increasing ( nondecreasing, )- Also let 
p(x) be nonnegative and periodic with per: iod l and let f p(x) dx > 0. Then 
0 


the integral 


" dx 
les 0) 
0 


and integral (6) are simultaneously convergent or divergent. r 
Proof. Let us represent formally integral (6) in the form of the series 
i (+1 


rox) 4 _ ome | 9- ia 
f WO dx= Y 4, where ^x vo) dx (8) 
0 k=0 ki 
By the periodicity of p, we have 
(k+ 1) ! t 
J p(x) dx = f pikit du = fow du=p>0 
kl 0 0 


and, since y increases, we obviously have 
—f —— k 20,1 

(D) =k 7 yb (k= 0,1,...) (9) 

The integral on the left-hand side of (8) converges or diverges simultane- 

ously with the series on the right-hand side of (8) which, in its turn, converges 


or diverges, by virtue of (9), simultaneously with the series Y, su . Finally, 
k=0 
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by the foregoing theorem, the last series converges or diverges simultane- 
ously with integral (7) and thus the theorem has been proved. 


Example 1. By Theorem 3, we have 


j axl av 


Here when using this theorem we put / = z, q(x) = {sin x| and p(x) = 


Example 2. Let us consider the integral 


sin x 
Í lande (x > 0) (10) 
L 


Its only singularity is at the point x = æ. It is absolutely convergent for 


x1: 
isinsi - TI 
Ta? i Lsinx|' xt | 
2 


pex 


dx 
because x? ~ x*— 1 (x > e) and f —— «e. 
x 


2 
For x = 1 integral (10) is not absolutely convergent because, by virtue of 
the last theorem, 





i sin x] ] js |sin nx us 
] erma = pp eere 


a T 


Indeed, the function |sin x| is continuous and periodic with period a and 
7 E 


P. [sin xl dx = ir sin x dx = 2 > 0 while the function x*4- 1 is continuous 


But nevertheless integral (10) is convergent (not absolutely, i.e. condition- 
ally) me 1/2 < « 1. Indeed, the integration " parts gives us 





sin x i Peo x (ax7-1+cos cos x (xx*—1+cos x) 
ur m — z dx 
a*+sin x aysin h (a? + sin ~~ @t+sinx — 


where the first term on the right-hand side has a finite limit as N — > for 
z > 0 and the second term is the sum of the two integrals 
N N A 
P oe: cos? x : " cos x:x*— 
W=- ri and Waal Gago 
1 


20006— 25 
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We have 


[cos x| x77! 


Laudis : x*—1 ~ dx 
(x*+ sin x)" dx =f op dx < cf <2 
i 2 


s~, 


and therefore /y tends to a finite limit as N — œ for any « > 0, and the 
problem thus reduces to the investigation of Iy. 





For « > 0 the integral j Tyt converges or diverges simul- 
taneously with the integral 
i cos (11) 


(see Remark 1 at the end of $9.13) because x*+sin x ~ x* (x — e). 
As to integral (11), it is convergent or divergent simultaneously with the 





invert | £ 
f dx 2 [dx 2 
[m-- 7^” d [geste Pg lie 
T "n 


(see the foregoing theorem). 
Hence, the limit of Jy as N — œ only exists when « > 1/2and therefore - 
integral (10) is only convergent fora — 1/2. 


8 9.16.. Improper Integrals with Singularities - 
at Several Points 


Let (a, b) be an open interval (finite or infinite) on which a function fis 
defined such that the integral 


b 
[ £0) dx q) 


has singularities only at the points a and b. This means that either a — — œ 
or a is a finite point and the function f is unbounded in its neighbourhood 
and, similarly, either b — -- » or b is a finite point and the function f is 
unbounded in its neighbourhood; besides, the function f is integrable on 
any closed interval [a', b'] such that a < a’ < b' < 

An arbitrary point c belonging to the interval (a, b) divides it into two 
subintervals (a, c) and (c, b). 
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The integral 


[ £060 ax (2) 


has a singularity only at the point a; the integra) 
b 
| #0) ax (3) 
€ 


also has only one singularity (at the point b). We already know in what 
sense the existence (convergence) of integrals of types (2) ang (3) is under- 
stood. 

Now we state the definition of the existence (convergence) 
(1): this integral exists (converges) if and only if each of the 
and (3) exists and, by definition, 


of integral 
integrals (2) 


& c b 
J £0) dx = [ A) ax [ fe) dx 


provided that both (2) and (3) are convergent integrals. 
The convergence or divergence of the integral understood in the sense 
of this definition does not in fact depend on the choice of c. For ifa < c < 


<c' < b then 
boc b 
i-i w 


c 
c 


where f is a proper integral, and, similarly, 


: € c c 
pepe (5) 


e 
On adding together (4) and (5) and cancelling f we obtain 


prend 


Let us proceed to a more complicated case. Let us take (by now purely 
formally) an integral 


c 


, 


b 
| £0) dx (6) 


388 A COURSE OF MATHEMATICAL ANALYSIS 


where the interval (a, b) is finite or infinite. Suppose that this interval can be 
split with the aid of points of division a = cy < C} < cs « ... «€, 1 < 
< c, = 6 into a finite number n of subintervals (cp, c4..1) such that each 
of the integrals 


Cet 


J fods — (k20,1,...,n-1) (7) 


has a singularity at only one of the end points c; and cy, 1. 
Then, if all improper integrals (7) exist (converge) we regard (by defini- 
tion) integral (6) as existing (convergent) and put 
5 Chet 


M n—1 
X) dx = Ix 
J SQ) dx 2 J fdx 


If at least one of integrals (7) is divergent, integral (6) is regarded as 
divergent (nonexisting). 

Similarly, we say that integral (6) is absolutely convergent if and only if 
all integrals (7) are absolutely convergent. 

In connection with the question under consideration the following remark 
should be taken into account. Let us suppose that, for instance, the point a 
is finite, b is a finite number exceeding a (a < b < æ) and the integral 


f fax (8) 

has, in addition to the point x = œ, one more singularity at the point b. 
Let b < c <æ. Then, in accordance with the above, improper integral 
(8) (we suppose that it exists) can also be defined in the following way: 


f fax 


a 


il 


b € e» 
f fax+ f fdx+ f rax = 
a b c 


b—ey s lea 


lim fdx4 lim | f dx4- lim j fdx= 
bte: c 


£770 z £20 £370 


b-c c Les | 


lim f fdx+ f fdx+ | se (En €2, €3 > 0) (9) 


£1 £2 £3 — 0 bte: 


This means that if improper integral (8) exists then the limit of the expression 
in the braces on the right-hand side of (9) also exists when the positive 
variables £;, &» and «s tend to zero independently of each other*. It is im- 








* Here we deal with the limit of a function of three variables (e,, £, and c5) defined 
on the set of points with positive coordinates as the variable point (belonging to that set) 
tends in an arbitrary way to the point with zero coordinates (to the origin). 
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portant to stress that the converse assertion also holds, that is if the limit of 
the right-hand side of (9) exists when €, £2 and ey independently tend to zero 
retaining positive values, each of the three limits entering into the middle 
member of (9) also exists, that is improper integral (8) is convergent (exists). 
To prove what has been stated, let us denote 

b-Z Meg 


q(e) = I fdx, poe) = [ fas pales) = | dde 


bas c 
Suppose that the limit 
Hn , VG) + Plea) + qa(63)j 


is known to exist. T. A the conditions of Cauchy's criterion must hold: 
given any 7 > 0, there is 6 = O such that if O < £1, €2, Eg, E1, €2, E3 < Ô 
then 

ip(e) +pa(e2)+ (63) — 91(61) — (62) — palez) < 7 


In particular, here it is allowable to put £» = £z and €3 = e3; then we see 
that for any 7 — O0 there is à — 0 such that |gi(e))— qi(&)l «9 for 
0 = £1, & < Ó, which shows that the limit 
lim gi(ei) (10) 
€ —0 
exists. The existence of the other two limits is proved analogously, that is the 
limits 
lim go(ex) and lim ga(e3) (11) 
£20 £930 
also exist. : 

Thus, we have proved that for integral (8) to exist it is necessary and 
sufficient that the limit on the right-hand side of (9) exist when £1, £» and 
£3 tend to zero independently of each other retaining positive sign. 

The assumption that the variables £, £2 and e are independent is essential 
for this proposition. If, for instance, it is only known that the limit on the 
right-hand side of (9) exists when £1 = £2 = £3 — O this does not, generally 
speaking, imply the existence of each of the limits (10) and (11) taken sep- 
arately. 

These considerations can be extended in a natural way to all the other 
possible types of location of the singularities of the integral. 

As an instance, let us consider the integral 


1 


dx 
UE (12) 
-1 


It has only one singularity (at the point x = 0). It does not exist (is diver- 
9 


gent) since neither of the integrals fe and j$ — exists separately. 
-1 


390 A COURSE OF MATHEMATICAL ANALYSIS 


In accordance with the discussion we can also say that integral (12) does 
not exist because the limit 


pu ed 
{4 LL S = In|xi|* ‘In Ixlf Lir. 
A 5 : 


does not exist when e; and es tend to zero independently of each other 
retaining positive sign. 

We thus conclude that the improper (Riemann) integral of the function 
1/x on the closed interval [— 1, 1] does not exist. 

Here we also mention an important generalization of the improper 
integral i in the sense of Cauchy's principal value; in this sense the integral 
in question is understood as the limit 


8 1 
dx : dx dx | _ 
VE [E-i] aa ea i 
-1 -1 E 


(here take we £ = £1 = &2!; the notation "v.p." originates from French 
valeur principale — principal value). 


§ 9.17. Taylor’s Formula with Integral Form 
of the Remainder 


Let f be a function defined in an open interval containing a point a and 
let the function f have continuous piecewise smooth derivative of the (r— 1)th 
order in this interval. Then the derivatives f? = f, f, f”, -.. f1} exist 
on that interval and are continuous and the derivative f' vx) exists through- 
out the indicated interval except at a finite number of points and is a piece- 
wise continuous function (see $ 5.15). For any point x belonging to this 
interval there holds pe dcus 


f(x) = bi Ce —ay--- R(x) a) 





with the remainder in the TUNE form 
1f - 
R(x) = yoy) -D Lf) dt  (0!=1) (2) 


Indeed, successive integrations by parts of R(x) yield 


x 

(r—1), = 1 Ur » 

R(x) — gear Mec | 6-0 ? fe7»(t) dr = 
a 








£—1) 
= -LPO s ga LO way- 
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toy J (x— Y-I f-t) dt = 





== F D Gs aye fi) 


The substitution ¢ = a+(x—a)u, dt = (x—a) du in integral (2) leads to 
the following expression for the remainder: 


R(x) = (x— ay y(x) 


where 
y(x) — aa GDI j (1— uy! f(a+ (x— a) u) du (3) 


If /?(x) is continuous then y(x) is also a continuous function of x because 
integral (3) satisfies the conditions of the theorem on the continuity of an 
integral dependent on a parameter proved in $ 12.13, Vol. 2. If the function 
J possesses continuous derivatives of higher order /(**5(x) (s = 0) then it is 
legitimate to differentiate y(x) s times under the integral sign (see $ 13.12). 
Therefore, in this case p(x) is s times continuously differentiable. This 
conclusion cannot be drawn from Lagrange's form of the remainder in 
Taylor's formula because it involves the function 0 whose differentiability 
properties are unknown a priori. 


§ 9.18. Wallis** and Stirling’s** Formulas 


Wallis’ formula is written as 


= (m!)222 
yz = Jim Omiya (1) 
n2 


To derive it we take the integral Í sin" x dx and integrate by parts: 


n/2 a n/2 
. . mi . 
Í sin” x dx = — sin”? x cos x i JT (n— 1) f sin^7? x cos? x dx = 


n2 al? 
= (n- 1) f sin"? x dx- (n— 1) | sin" x dx 
9 0 


* J.. Wallis (1616-1703), an English mathematician. 
** J Stirling (1692-1770), a Scotch mathematician. 
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On transposing the second integral on the right-hand side to the left and 
dividing by we receive 


al? i n2 
. n-— : 4 
f sin" x dx = LÍ sin"? x dx Q) 
0 


Proceeding from an even n and an odd n and applying in succession equality 
(2) (which reduces the power of sin x by 2) we obtain respectively 








a/2 al 
f sin" x dx = 20-1 ms po al dx DOT z 
0 
and 
an am 
d 0 


Now, dividing these equalities by each other and putting 


n/2 
f Sin?" x dx 


Lm = xg —— (n—1,2, ...) 
f sin?"*! € dx 
ò 


we arrive at the equality 


[Qr 
Om- in Qni) a" (3) 


Note that for x € [0, 2/2] we have 


sin?" *! x « sin?" x « sin™ 1 x 


1-2 


whence 
n2 al af2 
f sin2"*1 y dx = f sin?" x dx = f sin?"^! x dx 
0 ò 


On dividing the members of these inequalities by f sin?"*! x dx and applying 
0 
equality (2) we obtain 


_ 2nt+l 


1 
m 7 ae 





l= pus 2 af) 


a/2 
J sin?"^! x dx 
J sin?**! x dx 
0 
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whence it follows that 
Um > l (m — æ) (4) 


From (3) and (4) we derive the asymptotic relation 


((2m) 11} as 2 (oa on) 2m 


* 2-3 DWOmciü DH 


(m — e) 


obtained by discarding in succession the factors um — | and a - |, 


1 
whence 


me p nati zat 
Ome 1 dis n 
-2 mt A7 amine 00700) 





that is (1) takes place. 
Stirling's formula is written as the limiting relation 


lim ute (5) 


no» oo V 2a n3 12 e77 


or, which is the same, as the asymptotic equality 








n! œ y2z n+! e7" (n= =) (6) 
We shall derive the inequalities 
y2z n^*9/9 emn < n! < V2r n* 92 ent (Lian) (7) 
which directly imply (5) and (6). 
Let us put 
I 
an= -ap 0-52.) (8) 
Then . 
a l dyeram 
Og E [4 (1+ 7) 
po = pl: Ijz 
and In = (n) In(14+—)-1 
The function 1/x is monotone decreasing and Fig. 9.2 


its graph is convex downward for x — 0; there- 
fore the area of the figure bounded by the graph, by the x-axis and by 
the straight lines x = n and x = n+ 1 (see Fig. 9.2) is less than the area 
of the trapezoid nBC(n+1) and greater than the area of the trapezoid 
nB'C'(n-- 1) where B'C' is the segment of the tangent to the graph at its 
point with abscissa x = n+1/2: 

nal 


A x | Z =in(1++) tuu) 
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On multiplying the members of these inequalities by n+ 1/2 and subtracting 
1 from all of them we obtain 





142 
1 1 (^3) i 1/1 i 
ps (n3) In ( +7)! a "ED d 4n(n4- 1) mU G- 
a, 1/1 1 
Tt follows that 0 < In "m < a uu) whence 
1/1 1 
l< Ay | = ot Gras) (9) 
n+) 


Now we substitute n--j (j = 0,1, ..., k — I) for n into these inequalities 
and multiply them all, which results in 
l(L-.) 
] < a, <e 4 \n ntk (10) 
Üsk 
The first inequality (9) shows that the sequence of the positive numbers 
a; (j= 1,2, ...) is monotone decreasing and, consequently, tends to a 
nonnegative limit which we denote by «. From inequalities (10), on passing 
to the limit as k — e», we obtain 


l< = e eltu (11) 


whence it follows that a > 0. 
Wallis’ formula can obviously be written in terms of the numbers a, as 


Vz- lim a= 4 
neo duY2 VI 





and consequently 
a = Y (12) 
Finally, (8), (11) and (12) imply (7). 


CHAPTER 10 


Some Applications of Integrals. 
Approximate Methods 


§ 10.1. Area in Polar Coordinates 


The area S of the figure bounded by two rays 0 = 0, and 0 = @, issued 
from the pole O and by a curve I represented in polar coordinates by a 
continuous function o = f(0) (see Fig. 10.1) can be computed in the 
following way. 

We partition the interval [0o;0,] of variation of 6 with the aid of points 
of division 


09 < 0, — ... «0, — 0, 


and take the expression 1/20240, (40, = 0,,.1— 04) as an approximation to 
the area of the element of the figure bounded by the curve I’ and by the 
two rays 0 = 6, and 0 = 6,41; this means that we replace the area of the 
element by the area k+ 1 of the circular sector of radius o, = f(0,) bounded 
by the same rays. Now it appears natural to define the area of the figure 
in question by putting 


c 9, 9, 
S= lim Y e 40, = + J edo = I j| POO (1) 
0 à 6o 0, f 


max 40; —0 


Formula (1) expresses the area S of the figure in polar coordinates. As is 
already known, integral (1) is sùre to exist if the function f (0) is continuous. 

In connection with formula (1) there arises the question as to whether 
the area S would retain the same numerical value if we computed it in 
Cartesian coordinates. The general theory of the Jordan measure developed 
in § 12.4, Vol. 2 gives a positive answer to this question. 


Example. The circumference of the circle shown in Fig. 10.2 is described 
in polar coordinates by the equation o = 2R cos 0. According to (1), its 
area is found by computing the integral 


nl2 ajz 
S = 2R f cos? 8 dà = 4R? f 120s 20. 49 — aR? 
0 


—nl2 


395 


396 A COURSE OF MATHEMATICAL ANALYSIS 


6,=8, 





Fig. 10.1 Fig. 10.2 


§ 10.2. Volume of a Solid of Revolution 


Let /" be a curve described in rectangular coordinates x, y by a continuous 
Positive function y = f(x) (a = x = b). We shall compute the volume V of 
the solid of revolution bounded by the planes x = a and x = b and by the 
surface of revolution generated by the rotation of the curve I" about the x- 
axis. 

Let us partition the interval [a, b] with the aid of points of division a = xo 
Xie. < Xa = b and assume that the volume of the element AV of 
the solid bounded by the planes x = x, and x = x,4411s approximately equal 


to the volume of the circular cylinder with radius y, = f(x.) and altitude 
Oxk = Xia — xy: 


AV ~ nyk-Axy = nf (x1)? Axx 


n—-i 
The sum V, = x >; FG. 4x, gives us an approximation to the sought- 


0 
for volume V which is ultimately obtained by passing to the limit: 


b 
V= lim Sls)? Axe n [Pad (1) 
0 a 


max dx,—-0 


Formula (1) expresses the volume of the solid of revolution. 

We shall also present an alternative derivation of formula (1) based on the 
notion of the differential of volume. Let V (x) denote the volume of the part of 
the solid in question lying between the planes passing through the points a 
and x of the x-axis perpendicularly to the latter (Fig. 10.3). The increment 
AV (x) of the volume V(x) corresponding to the increment 4x = 0 of the 
coordinate x is equal to the volume of the part of the body lying between the 


aa perpendicular to the x-axis and passing through the points x and 
x 4x, 
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Let us prove the equality 
AV = zf*(x) Ax-- o(4x) 
(dx — 0) (2) 
To this end we put 
m= min f) and 


x«t£caxdx 


M= max f(s) 


xebsxt Ax 


Then, obviously, 
am Ax = AV (x) = aM? dx, 
am? Ax = af?(x) Ax = xM? Ax 
(3) . 


and, since the function f(x) is continuous, M—m — 0 (4x — 0). This means 
that 





z(M?— m?) Ax = o(Ax) (4x — 0) (4) 


From (3) and (4) now follows (2). 
Equality (2) shows that the first term on its right-hand side is the differen- 
tial of V: 


dV = zf?*(x) dx = af x) Ax 


Finally, by the Newton-Leibniz theorem, the sought-for volume F is 
b 


V = V(b) = V(b)-V(a) = 2 f Px) dx 


Example. The ellipsoid of revolution (about the x-axis) described by the 
equation 
xo ie st O 1 


et 


is a body bounded by the surface of revolution generated by the rotation 
about the x-axis of the curve 


-ipi-5 (—asx-«a) 


Formula (1) gives the following expression for its volume: 


V = ab? [(i-4) dx = ab? (x- x. = $ mab? 





-a 
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§ 10.3. Arc Length of a Smooth Curve 


Let /" be a smooth curve described by functions 
x-9g(f, y=, z-»(, a<te<eb (1) 


(see § 6.5). The smoothness of I’ means that the functions g(t), p(s) and z(t) 
have continuous derivatives on [a, b]. Let us take a partition a = to < tı < 
=<... < f, = bof [a, b] and form the sum (see § 6.8) 


n-i ; 
0 
where 
Axy = P(tk+1)— Pll) Ayk = plea — We) 
Azk = Z(fk+1)— X(f) and ô= mar Atk, Aty = tei tk 


This sum is obviously equal to the length of the polygonal line inscribed in I" 
with vertices at the points corresponding to the values £! = ty. 
Now we can write 


n-1 nd pcr — 
S, = F Ve' (uw Guy x A? At, = Y Vo' (y 3v)! x Y Att 
: n-1l 3 E —————— Ms 
Y er dte [Vor rv Ote d 
0 a 


where px, v, and A, are some points belonging to the interval (fk, £41) : tk < 
< Bk, Phy Ax < thei (k = 0,1, ..., n— 1). l 

Here in the first equality we have used Lagrange’s formula. of finite in- 
crements. l 

To justify the fact that Y ex At, — O as 6 -- O let us consider the auxilia- 
ry function 


a(u, v, w) = Vp U+ or 4- x Q0? 


which is obviously continuous in the cube 4 = (a = u, v, w « b). Its modu- 
lus of continuity on 4 will be denoted by o(). Since the distance between 
the points (fk, £4, fk) and (itk, Yk, Ak) belonging to the cube does not exceed 
8y3 we have 


lel = def, tes 5) — n Pas Ax)| = o(573) 
and therefore 


1 4—1 j n—1 
Ey ex At| <w (8V3) Y, At = (b-a)o(0/3) -0, 5-0 
i0 0 
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We have proved that the arc length of smooth curve (1) exists and is given 
by the formula 


b 
S = [Yo Gv GY di (2) 


Making the change of variable t = 4(z) (2'(t) > 0, c = t = d) in formula 
(2) where 2() is a continuously differentiable function we obviously obtain 
d 


S = | Veo! cvi 1 de (3) 


where p(T) = 9(A(z)) etc., which shows that formula (2) expressing the arc 
length is invariant with respect to change of variable. 
If a plane curve is represented by an equation 


»-fG  (a«x«b) 


where f possesses a continuous derivative on [a, b] its arc length is expressed 
by the formula 


b 
S = [Y £69: dx 


which readily follows from (2) if we put t = x, y = f(x) and z = 0. 


Example. Using formula (2) we obtain for arc length of the screw line 
x=acos#, y=asin0, z= bð, (0 = 0 = bo) 


the expression 
9 


S= f Var+b2 dÀ = Oo yt b? 
0 


8 10.4. Area of a Surface of Revolution 


Let I? bea plane curve described by a positive function y = f(x) (a = x = 
«x b) in rectangular coordinates and let f be continuously differentiable on 
Ta, b]. 

We shall compute the area S of the surface of revolution generated by the 
rotation of I’ about the x-axis. To this end we take a partition 


ü-—xXo9-Xi...—X,—b (1) 


of the interval [a, b] and inscribe in the curve I the polygonal line I’, with 
vertices at the points (xx, f(xx)). The area of the surface of revolution gene- 
rated by the rotation of the polygonal line about the x-axis is 


Sa = a Y UG) fred VERDE, Aye = fue) Sen) 
9 
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To find the sought-for area S we pass to the limit as max 4x, > O and 
receive 


b b 
S =22 Í SX) VIFP' OY dx = 2æ [ pity? dx (2) 


Indeed, on taking 4x, (4x, > 0) outside the root and applying to dy, the 
formula of finite increments we obtain (see the explanations below) 


$,—7 Y Sx) +f Se DV TES EF dox = 


= 2n ESOT CP Ax, +0 — 22 [neo (X? dx, 


(max dx, + 0, xy < £y < x«i) 

To prove that 
a — 0 as max Ax, — 0 (3) 
let us consider the auxiliary function ®(€, 7, 2) = [/(5)--/G]V1 yrxrG T'È 
which is defined and continuous in the cube 4 = {a «5,7, 2 =b]; since the 


cube A is a closed set the function ®(é, 7, ¢) is uniformly continuous in J. 
It follows that, given any £ > 0, there is ô > O such that 


19x, N, t) —éX£, 7, ẸNI < (b-a)a aR 


provided that |y— 7 | « à, |€—2'| < dand (6, n, C), (E, 7’, °) € 4. Therefore, 
if partition (1) is such that max Ax, < 6 we have 


€ 
IG (xy, xi 1, SA) 7 Ox, xi, x) < TEO 


and consequently 
n—l n- | n-1 
ja] = [2 Y, Gus Xrti Fk) Axr Y, Os Xi, Xx) a < P Y dx -85 
| 0 0 ~" o 


which proves (3). 
The general definition of area of an arbitrary smooth surface will be stated. 
in § 12.23, Vol. 2. 


Example. Applying formula (2) we readily find the area of the surface 
of revolution generated by the rotation of the segment of the parabola 
y = X? (0 x « 1) about the x-axis: 

1 


S= 2a | x*V 1+ 4x? dx 
0 
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§ 10.5. Lagrange’s Interpolation Formula 


Consider a function f defined on a closed interval [a, b] and a system of 
points 


Xo, Xj, <- Xn (1) 


belonging to [a, b]. Let us consider the following problem: it is required to 
find a polynomial P(x) = do+aix+...+4,x" of degree n whose values at 
the indicated points coincide with the values of the function f(x), that is 


S(x) =P) (K = 0,1, ..., n) (2) 
Yo solve the problem we construct the polynomials 


iy A Xo) 2 Q— X (K— X41) -o (XXn) — 
(4) uy (k=O, h.n) 
(3) 


li is obvious that, for every k = 0, 1, ..., n, the function Q, is a polynomial 
of the nth degree equal to 1 at the point x, and to O at the other points of 
system (ID): 
Qux) = ony (k, j7=0, 1, ..., n) 
where tie symbol ô,” is specified by the relations 
ot [1 fo kj 
[0 for k#j 


Let us put 
Po) = $04) FH) (4) 
The function P(x) is a polynomial of degree n possessing the properties 
P(x,) = Y QM G4 - QM) fo) | Go 61... n) 


Thus, it is a solution to the problem in question: besides, it is determined 
uniquely because if we supposed that there is another polynomial Pi(x) of 
the nth degree serving as a solution to the same problem, the difference P(x)— 
— Pi(x) would be a polynomial of the nth degree having (n+ 1) distinct roots 
whence it would follow that P(x)- Pi(x) = 0. 

It should be noted that if the original function / is itself a polynomial of 
degree n then we have the identity /(x| = P(x} because two polynomials 
whose values coincide at (7+ 1) distinct points are identically equal to each 
other. Relations (3), (4) express the so-called Lagrange interpolation formula. 





* The symbol ôy is called the Kroneker delta after L. i&roneker (1823-1891), a German 
mathematician. — 7r. 


20006 — 26 





402 A COURSE OF MATHEMATICAL ANALYSIS 


§ 10.6. Rectangle and Trapezoid Formulas 


Let it be required to compute the definite integral of a continuous function 
J on an interval (a, b]. If its antiderivative is known we can naturally apply 
the Newton-Leibniz theorem. But, as is known, an antiderivative of a con- 
tinuous function by far not always can be found analytically, and therefore 
there arises the problem of an approximate computation of the integral. 

One of the simplest methods for approximate computation of a definite 
integral is directly implied by its definition. Let us divide the interval of in- 
tegration [a, b] into equal parts with the aid of the points 


(k 20,1, ..., N) () 





and put 





b - 
[69 dx = ^x^ È peaj (2) 


where the sign “=~ ” indicates an approximate equality. 

Relation (2) is referred to as the rectangle formula (or the rectangle rule; 
formulas of this kind are termed quadrature formulas). Fig. 10.4 shows that 
in the case of a positive function f(x), for which the integral in question is 













B 


Fig. 10.4 





equal to the area of the figure bounded by the curve y — f(x), by the x-axis 
and by the straight lines x — a and x — b, formula (2) gives an approxima- 
tion to this area equal to the sum of the areas of the rectangles seen in the 
figure. 

As is known, in the case of a continuous function f on [a, b] the limit, as 
N - ©, of the right-hand member of formula (2) is exactly equal to its left- 
hand member; therefore it is natural to expect that the error of the approxi- 
mate formula (2), that is the absolute value of the difference between its 
right-hand and left-hand members, is small for large N. 

In this connection there arises the question as to how the error of such an 
approximation can be estimated. As will be shown, such an estimation can 
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readily be found if we require additionally that the function f (whichis sup- 
posed to be continuous) satisfy some smoothness conditions. 

It is important to stress that iff is a linear function of the form f (x) = Ax+ 
+B, formula (2) gives an exact equality : in this case the right-hand side of (2) 
exactly coincides with its left-hand side. Since a linear function is a polyno- 
mial of the first degree we can say that the rectangle formula provides an exact 
result for all polynomials of degree not higher than 1. 

Another natural method for computing approximately a definite integral 
leads to the so-called trapezoid (quadrature) formula (trapezoid rule J. 
According to this method, the interval of integration [a, b] is split into equal 
parts with the aid of a system of points of type (1) and the approximate ex- 
pression for the sought-for integral is written as 


b 
[rdx ~ boa (Fere. , eren 5 wie fern. fig) _ 


"M. CODAE) -+AA 8) 


As is seen from Fig. 10.5, the trapezoid formula expresses approximately 
the sought-for area as the sum of the areas of the trapezoids shown in the 
figure. It is important to note that the trapezoid formula provides an exact 








Fig. 10.5 


result for any linear function Ax-- B (where Aand B are constants), that is for 
any polynomial of degree not higher than 1: if an expression Ax+B is sub-. 
stituted for f (x) into (3) this relation becomes exact. In this sense the tra- 
pezoid formula has no advantages over the rectangle formula since they are 
both exact for linear functions. 


8 10.7. General Quadrature Formula. The Notion 
of a Functional 


In this section we shall generalize the notion of a quadrature formula. 
Let us take a system of points 


Gs Xo Xp... XyoxD (1) 
26* 
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splitting a given interval [a, b] and a system of numbers 
Po, py... PN (2) 


Taking an arbitrary continuous function f defined on [a, b] we put 


LD) = Yr Gu) 3) 
0 


L(/f) will be regarded (at present purely formally) as an approximation to 
the integral of f taken over [a, b] 


b 
[f@ax~ LY) (4) 


An approximate relation of form (4) will be referred to as the quadrature 
formula with nodes (1) and weights (2). 

Let M denote a set of functions f and let there be a law according to which 
with each function f € 3f is associated a number F(/). Then we say that 
F is a functional defined on M. If Mt is a linear space (see § 6.1) and if F 
possesses the property 


F(afit+Bfe) = «F(fi)- BFCf2) 


for any numbers « and f and any functions fi, f; € It the functional F 
(defined on Mt) is said to be linear. 
The set of all continuous functions defined on [a, b] is usually denoted 
as C = C(a, b). It is a linear space because if « and f are arbitrary numbers 
b 


and fi, fo € C then afit ff; € C. The integral J f dx can obviously be re- 


garded as a linear functional on C. It is readily seen that the expression 

L(/) (see (3)) is also a linear functional defined on C. It follows that if 

equality (4) is exact for a finite number of continuous functions fi, ..., fr 
i 


it is automatically exact for the functions (linear combinations) Farf) 
1 


where c; are arbitrary numbers. 


8 10.8. Simpson’s* Formula 


In this section we shall derive an important quadrature formula used in 
approximate calculations known as Simpson's formula (or Simpson's rule). 
It is quite simple and at the same time possesses a remarkable property: 
it is exact for all polynomials of the third degree. 


* T. Simpson (1710-1761), an English mathematician. 
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We shall begin with the auxiliary problem: it is required to determine 
three numbers A, B and C such that the quadrature formula 


1 
JA ax = Af(-1)+ BF) +-CF) (1) 
-1 


is exact for the functions 1, x and x?. On substituting these functions for f 
into (1) and writing the exact equalities we arrive at the system of three 
equations 


whence A = C = 1/3and B = 4/3. Now, since A = Citcan readily be verified 
that formula (1) with the values.of A, B and C found is exact for the function 
x as well; since the functionals entering into formula (1) are linear (see 
the foregoing section) the formula is also exact for all polynomials of 
degree not higher than the third. 

For an arbitrary interval [2, b] the generalized formula of type (1) is 
written as 


b 
[Aad  *2* (ra -4r(55*) 0) (2) 








Let us show that formula (2) is exact for all polynomials of the third 
degree. Indeed, on putting 
b—a 

2 


at 


b 
x=- +t 











and F(t) = s(t) 


in (2) and cancelling by a we obtain 
T! ihe’ 
f F()) dt ~ -z (F(~1)+4F(0)+F(1)) (3) 
-1 


Since formula (3) is exact for the polynomials in ¢ of degree not higher 
than the third, formula (2) is exact for the polynomials in x of degree not 


higher than the third because the substitution x = are +1254 trans- 
forms the polynomials of degree not higher than the third dependent on x 
into the polynomials of degree not higher than the third dependent on ¢. 


If we split a given closed interval [a, b] into 2N equal parts with the aid 
of the points of division 





b—a 


xk REDE 





k  (k20,L ...,2N) 
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and apply formula (2) to each of the subintervals [xo, x2], [x2, x4], ..., the 
addition of the results obtained leads to Simpson's formula 


b 
[I dx = ESENES (ea) + 4f G)---.." fr) A 


From the point of view of practical applications the amounts of calcula- 
tions involved in Simpson's formula and in the rectangle formula are 
essentially the same. But if the integrand function f is sufficiently smooth 
then, for large N, the error of the approximation computed by Simpson's 
formula is considerably smaller than the corresponding error introduced 
by the rectangle formula (see $ 10.9). 


8 10.9. General Method for Estimating Errors 
of Quadrature Formulas 


The formula 
1 
[IO ae « Y SG) = 1) (1) 
0 0 


written for the interval [0, 1] will be referred to as the standard quadrature 
formula with nodes 
Oey miim... femi (2) 
and weights 
Pos Pis + +9 Pa (3) 
To standard formula (1) there corresponds the quadrature formula 


d ; 
[r6 dx = 4- Y; ndf(c--(a- 3) = @-L(F(e+(d=0))) (4) 
c 0 


for the interval [c, d]. Its nodes c-4- (d— c) ¢, divide the interval [c,d] in the 
same ratio in which the nodes £; of the standard formula divide the interval 
[0, 1], the corresponding weights being (d— c) p, (k = 0, 1, ..., n). 

If an interval [a, b] is split into equal parts by the points 


xai tk — (k 0,1... N) 


we can apply to each subinterval [x,, x41] the formula 


Xpt 
"i b b-a 


| dx = x L(f(n y 1)) 











corresponding to the standard formula and then perform the summation 
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of its left and right members with respect to k. This results in the formula 


(reet) o 


which will be referred to as the modified quadrature formula corresponding 
to standard formula (1). 

To estimate the error introduced by formula (5) let us suppose that the 
original standard formula is exact for all polynomials of degree not higher 
than r— 1. 

Let W'(a, b) denote the class of functions f defined on the closed interval 
[a,b] and having the continuous piecewise smooth derivative f^? on 
[a, b] (see the beginning of 5 9.17). 

If f is a function belonging to W'(0, 1) (f € W*(0, 1)) we can write its 
expansion by Taylor's formula with remainder in integral form (see § 9.17): 
f(x) = P(x)+ R(x) where 





r—1 
P(x) = Y, ayx* 
0 


and N 
RQ) = gr J œY- fOe) dt = J K(x—1) f ?(0) dt 


Here we have introduced the function 
0 for u-«O0 
K(u) = 1 4 
(=p! for u-0 


Let us substitute f into standard formula (1) and transpose all the terms 
to the left-hand side. Since formula (1) is exact for the polynomial P(x) 
we obtain 





Í fe) 4«- LC) - 
0 


(f | &e-2790 a) dx— È PeK(xx— 0) SO dt = 


1 
| 
1 
= | ( J K(x— 1) ax) f(D) dt— j (Eoo - 0) fnr = 

= f AD S(O dt* 


* Here we have changed the order of integration. The justification of such a procedure 
is presented in the theory of multiple integrals (see Chapter 12, Vol. 2). 
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where 
1 
A(t) = | KG- 0 dx- iK Gi 0 (6) 
0 9 
Now, denoting 
1 
x= [14c91dr (7) 
and i 
fen SUD. FAKOJ (8) 


we receive the inequality 
1 
| fr dx- Lf) | slut (9) 
10 D 


The function A(é) and, together with it, the constant z are dependent on 
the weights and on the location of the nodes in formula (1) but are independ- 
ent of the function f. The constant x can be computed for a given standard 
formula and then automatically used in calculations. Its value is determined 
precisely since for the function f € W‘? (0, 1) having the derivative f(x) = 
= sgn A(x) relation (9) turns into an exact equality. 

Now let us derive an estimation for the error of formula (4) corresponding 
to a closed interval [c, d] on condition that f € W'(c, d). On transposing the 
second term in (4) to the left-hand side and making the substitution 


x = cd (d—o)t, F(t) = f(c4- (d— c) 1) 
we obtain, taking into account that Ff?(r) = (d— c) f(x), the equality 


d 
[ 70) àx- a- 91(f(e* 4-912) 








= (d- c) J roan] «(d—c)x || FP [lo = 





= (d—cy t3» ISP lle, à) (10) 


where lelke a = sup ig(x)l. 
exxsd 


Inequality (10) involves as a factor the above constant x and, besides, 
contains the new factor (d— c)'* ! dependent on the length d— c of the interval 
[c, d). This factor tends to zero together with d— c, the rate of its decrease 
increasing together with r. 

Finally, let us estimate the error for modified formula (5) on condition 
that f€ W'(a, b). Since in this case we have f € W'(x,, xy41) for any k, 
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it follows, by virtue of (10), that 





b "D : 
frod- RE Y L(r f (s^ 1) )i- 


= z Í Sods - S25 L (f (wet tt iis 


- +1 b- i 
7 2 n NFO los. Apri) S eas n yin i(a, b) (11) 


We shall say that a given modified quadrature formula possesses property 
T*-1 if it is exact for the polynomials of the (r—1)th degree. As has been 
proved, if a function f belongs to W'(a, b) (f € W'(a, b) = Wr") and if the 
integral of that function is approximated on [a, b] by a modified quadrature 
formula (5) possessing propetty T’—}, the error of the approximation is of 
the order of N~”, 

Here we also note (without proof) that if / € W* and if formula (5) has 
property 7*-* the errors of the approximations for k <r and for k =r 
are of the orders of N-* and N~" respectively. 

As an example let us take Simpson's formula; it possesses property T? 
and therefore the error of the approximation of the integral of a function 
f € W* with the aid of this formula is of the order of N^ for k = 4 and of 
the order of N-* for k < 4. 

In conclusion we make the following remark. Let us consider a system 
of nodes xo < xı < ... < x, For this system an arbitrary polynomial 
P(x) of the rth degree can be represented exactly (identically) with the aid 
of Lagrange's interpolation formula (3), (4) derived in § 10.5. Putting 


b 
pe f Qu(x) ax (k 5 0,1, ..., n) 


we obtain the quadrature formula 
b 
[IO dx = F MfG) 
a 0 

which is exact for any polynomial of degree r. 


§ 10.10. More on Arc Length 


In this section we suppose without further stipulations that J” is a contin- 
uous curve not intersecting itself, determined by equations 


x=), y=y), z=), ast«b (1) 


where the functions g(t), y(t) and (7) are continuous. 
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Let us introduce the following notation: if p is a partition 
a — flo x fy x lo <... n Iy b (2) 


of the interval [a, b] then 
6, = max dt, a, = max V dx? 4- Ay? + Az 
k k 


I, is the polygonal line inscribed in I with vertices corresponding to the 
values t € p and, finally, |] and 177, | are the lengths of F and I, respectively. 
If the curve I’ is not rectifiable (has no length) we put formally in| =<. 
There hold the following properties: 
(i) The relations 
5, ~ 0 (3) 


and 
Oa — 0 (4) 


imply each other and, consequently, the arc length of a continuous curve T 
can be defined by means of one of the two equivalent equalities 


|P| = lim |I| = lim |7; (5) 
5979 9o ^? 


Indeed, (3) implies (4) because the functions g, y and % are uniformly con- 
tinuous on (a, b]. Further, equations (1) specify a mapping under which the 
interval [a, b] of variation of £ goes in the set of points (x, y, z) belonging to 
T. This mapping is continuous and therefore the point set I’ is bounded and 
closed (see Theorem 1 in § 12.20). Since I" does not intersect itself this map- 
ping establishes a one-to-one correspondence [a, b] = T, and consequently, 
by the same theorem, the inverse mapping is also continuous and thus is 
described by a continuous function £ = (x, y, z) defined on the bounded 
closed set I? which is therefore uniformly continuous on I. 

(ii) If o<, that is if all the points of division t; entering into o (tj € o) 


also belong to o', then 
| Pe] = el (6) 


This is quite obvious. The addition to. of.one more point f; results in the 
replacement of a segment of the polygonal line T, by two segments forming 
together with the former segment a triangle (which may be degenerated, i.e. 
lying in a straight line). 

(iii) There hold the relations 


sup|J,] = lim A] = |Z" (7) 
e 9e 7-0 


The number |T| specified by them can be finite and then the curve I’ is 
rectifiable and |T} is its length (see § 6.8). It is also possible that |'| = + œ; 
then the curve I is not rectifiable. 

To prove (7) let us put A = sup |I] and choose arbitrary numbers A’ 


and A” such that A’ < A” < A. According to the property of the supre- 
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mum, there is a partition o* = {a= f <fi < ... < fv = b) such that 
A” < |I |. Let us take an arbitrary € < 7l" —/!' and choose, using the 
uniform continuity of the functions g(/), p(s) and y(t) on [a, b], a number 
ô > O such that the inequality 
2 = Vdx?+ Ay?+d2 < AN 

(where å is the length of the chord joining the points of /' corresponding to 7 
and t+ A) is fulfilled for all z, 1-- At € [a, b], |At| < ò. 

For any arbitrary partition o of the interval [a, b] with ô < ô there hold 
the inequalities (see the explanations below) 


A" < [Poe] < Perel < [Pel+e (8) 
which imply 
A’ < |Tel 
The second inequality (8) holds by virtue of Property (ii). The third one is 


explained as follows. Let 4A’ be the chord connecting two neighbouring 
vertices of T, and let » be the number of vertices of T'e contained inside the 


arc AA’ c T. Let us inscribe in AA’ the polygonal line v4, with vertices 
coinciding with the indicated vertices of Zp». The number of segments of 
this polygonal line is »--1 and the length of its each segment does not 


exceed Ww ; therefore the length of yax is not greater than ae), 


If all the chords 44' C I'; are replaced by the corresponding polygonal 


lines yax as described above for all the arcs AA’ inside which there are 
points of T», this results in the transformation of I, into I+. and, since 
the number of vertices of L',« which may fall in an arc y4, is not greater 
than N, we have 


Pose < lTel+e 


that is the third inequality (8) holds. We have proved that for any number 
A’ < Athere is 6 > 0 such that the inequality A’ < |I,| « 4 is fulfilled for 
all Tp; with à, < ô. This proves (7) where |I| = A.. 

(iv). If T is rectifiable on [a, b] then it is also rectifiable on [a, c] and [c, b], 
a < c < b; conversely, if T is rectifiable on [a, c] and on [c, b] it is rectifiable 
on [a, b] as well. In this case we have 


[P| = Pael tcl (9) 
Proof. Let us choose a sequence of partitions o* of the interval [a, b] with 
ô,» > O (k — œ=). Suppose that T,» contains a point c for any k. Then y 


generates the corresponding partitions of and of of [a, c] and [c, b] respec- 
tively with 5,2, Got + 0 (k +o) and 


el =|Lel+|Pe| («= 1,2, ...) (10) 
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If © is rectifiable, ie. || <œ, then |J] — |T|. Therefore |Pal and 
Ie are bounded and, since à, y ~> 0, they converge to |D';.| and |]. 
Thus lec and Tes are rectifiable. On passing to the limit in (10) as k — e» 
we obtain (9). Conversely, if Lae and /',, are rectifiable then | / Z =| Pac 2 


|Tel — | la| and therefore, by (10), the limit of | T| exits. Since 6,* ~> 
— 0 it follows, by (iii), that I is rectifiable. 

(v). Let T, (o «EX M) denote the arc of T corresponding to the interval 
[ate, b— e). If I. is rectifiable for any such € then 





lim || = |l (11) 
e+0 


Thus, for I to be rectifiable it is necessary and sufficient that the limit in (11) 
be finite. 

Proof. Let us inscribe in T, a polygonal line I", with segments whose 
lengths do not exceed £ such that 


Dl- e < |I = Tl (12) 


and let I,’ be the polygonal line inscribed in I and obtained by adding two 
segments to I. By the continuity of l’, we have 


IP |-lPl+0, e+0 (13) 


Evidently, |I",| does not decrease as e — 0. Therefore limit (11) (finite or 
infinite) exists and, by (7), (12) and (13), 


lim |Z| = lim [I| = lim |I} = I} 
e—0 e—0 e+0 


8 10.11. The Number :r. Trigonometric Functions 


Let us consider the circle x?4-y? = 1. Its upper. half (semicircle) I^ is 
described by the continuous function f(x) = V1—x5 —1 =x = 1. As to 
the derivative f'(x) = —x/V1— x2, it is only continuous in the open interval 
(—1, 1). Therefore at present formula (4) in $ 10.3 expressing arc length can 
only be applied to a closed interval [— 1-- e 1— e] (0 < e < 1) on which f 
is continuous together with its derivative: 








l—-e 1I-s 
T= f Yuxfeyé- f E 
-1-46 ER LE 


But the function (1— x?)-1 is integrable on the closed interval [—1, +1] if 
the integral is interpreted in the improper sense, and therefore, by Property 
(10) in $ 10.10, we have 

+1 


P| = lim] = [nx (1) 





I 
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which proves that the semicircle 7" is rectifiable and that its length is the 
number equal to the integral on the right-hand side of (1). It is this number 


that is called the number z: 
+1 


n= | -= (2) 


/1 3 
-X 
ud 


These considerations provide a rigorous proof of the existence of this 
important limit which meets the requirements of modern mathematical ana- 
lysis. In elementary geometry the definition of the arc length of a circle is 
stated quite correctly but its existence is justified by means of an intuitive 
argument accompanied by calculations. 

The function arc cos x can be defined with the aid of the equality 


—-l<x<] (3) 





a= accor = ff 


yi-e' 


where Ó is the length of the arc AB (see Fig. 10.6) and x is the abscissa of the 
point B belonging to the upper semicircle. 

We see that, according to the property of the definite integral as function 
of its lower limit, the function arc cos x is continuous; also it is strictly de- 
creasing on the closed interval [— 1, +1] y l 
and possesses the derivative B 





(arccos x) fie’ l<x=<1 
It is clear that arc cos 1=0, arc cos 0 = 
= 2/2 and arc cos (— 1) = x. ws 

What has been established guarantees 
the existence of the inverse function of 

arc cos x defined on the interval [0,7] 
which is monotone decreasing on this inter- 
val; this function is denoted x = cos @ and 
is called the cosine of the arc 0 (the latter Fig. 10.6 ` 
is supposed to be expressed in radians). . 

The notion of the arc length 0 is extended in an ordinary way to the whole 
real axis — œ -< 0 <æ. The function cos Ó is extended accordingly. 
Namely, we define cos 0 (— œ < 0 < æ) as an even function of period 27 
which coincides with the function cos @ defined above for the interval [0,7]. 
This definition of the cosine corresponds to the usual definition in which 
cos 0 is understood as the abscissa of the point B of the unit circle with 
coordinate 0 (equal to arc length). From the definition of the extension of 
the cosine and from the properties of cos 0 on the interval [0, x] it readily 
follows that cos 0 is continuously differentiable throughout the real axis 
— e» — <æ. Besides, from formula (3) it obviously follows that the 
function cos (z/2-4- u)is odd (as function of u): cos (7/2 +u) = —cos (z/2— u). 
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Now let us suppose that the variable 
point B is in the right semicircle 
(Fig. 10.7): 


x= Yl—y’, -ley=l 


The function 


6 = arcsin y = ae 


—-ley<xi (4) 





expresses the length of the arc AB ta- 
ken with the corresponding sign. This 
Fig. 10.7 function is obviously continuous, odd 

and strictly increasing on [—1, +1] 

and satisfies the conditions 0(—1) = —2/2, 6(0) = 0 and 6(--1) = 2/2. 
Besides, it is continuously differentiable on (— 1, +1). Its inverse function 


y = sinl 


is strictly increasing and continuous on [— 7/2, 7/2}. Its extension to the 
whole real axis — e» <  < is obtained by assuming that the extended func- 
tion sin ĝis periodic with period 2x and that the function sin (7/2+ u) (— œ < 
< u < c») is odd (as function of u). It can easily be verified that sin 0 is a 
continuous function on (— œ, œ) equal to the ordinate of the point B of the 
unit circle corresponding to the arc 0. 

It is clear that cos? 0--sin? 0 = 1, — œ< 0 <æ, because cos @ and 
sin 0 are, respectively, the abscissa and the ordinate of one and the same 
point belonging to the unit circle. 

There holds the equality 


x 


1 
aino fT * [oz =F —]«x«l (5) 
x 





1 
a= fats 
expressing geometrically the fact that, for any x € [—1, +1], the sum of the 
arc belonging to [—z¢/2, 21/2], whose sine is equal to x, and the arc belonging 
to [0, zz], whose cosine is equal to x, is equal to the number 7/2. 

If 0 € [0, x] and x = cos 0 then 0 = arc cos x, and, by virtue of (5), we 
have arcsin x = 2/2—6@; consequently 


- 


cos Ó — sin (2-9) (6) 


Similarly, if 0 € [—2/2, 2/2] and x = sin 0 then 0 = arcsin x and x/2— 
—6 = arc cos x, and, consequently, 


sin 8 = cos (2-9) (7) 
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Using the symmetry and periodicity properties of cos @ and sin 0 we can 
readily extend equalities (6) and (7) to the whole real axis — e «l9 <a, 
We also have the equalities 


(sin 6)’ = cos 0, (cos0y = —sin0, — œ < 0 < æ (8) 
For instance, from (4) follows 


d0 1 


whence we obtain the first equality (8): 
(sin 6)’ = 2. = ¥1—sin? 6 = cos 


for —z/2 «0 «z[2, and, by virtue of the symmetry and periodicity of 
the functions sin 0 and cos 9, for all the values of 0 as well. 

Using formulas (8) and the fact that cos 0 = 1 and sinO = 0 we can 
compute derivatives of any order of the functions cos 0 and sin 9 at the 
point 6 = 0 and then represent these functions by Taylor's formula with the 
remainer corresponding to an arbitrarily large as was already done in 
§ 5.10. Moreover, taking into account the boundedness of the higher-order 


d^ cos 0 <1 and 775^ «1) 








don dÜ^ 
we conclude, like in $ 5.10, that the remainder terms in the corresponding 
Taylor expansions tend to zero as n + œ for any 0. We thus arrive at the 
expansions of the functions in question in the power serics 


derivatives of the functions in question ( 





i 03 8* 
sin? = 0——... and cos@=1—-3;+... (9) 


by means of which it is possible to derive (see§ 11.13) the basic trigonometric 
formulas 


(10) 


cos («+ f) = cos « cos B—sin « sin f 
sin («--) = sin « cos B+cos « sin f 


Of course, it is also possible to obtain formulas (10) directly from (3) and 
(4). For instance, let 0 < «, f and «-- f = x. Then (see the explanations be- 
low) we have 


dx rbi ax’ ` dx’ ; dx' 


cos B 


























and at= f 


(3), we obtain the first formula (10) for the indicated « and £. 


dx’ s ; : 
Ix where z = cos « cos f —sin « sin f, whence, using 
-x 
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The second equality in (11) is obtained by means of the change of variable 
x' = x cos x—y1— x? sin x. The equality 











dx' z dx ER 
yi-x? yi-x 
follows from 
dx’ = ——— (cos “V1—x?+x sin x) dx 
y1-x: 


and 1— x? = (cos « V1— x*-- x sin )?. It should also be taken into acco- 
unt that the expression in the parentheses in this equality is nonnegative. 
Putting x = cos u, 0 = u « fl, we can rewrite this expression as cos æ sin u+ 
+cos u sin x. It is clearly nonnegative if «, u=<<2/2. In the case x < x/2, 
u > 7/2, taking into account that sin £ and cos ¢ are decreasing on [—u, 
x—a], we obtain 


cosg Sin u+ cos u Sin x = cos x sin (zz—a)-- cos (zt —«) sinc = 
= cosa sin g— cosa sing = 0 
The case u < :/2,« > 1/2 is treated similarly by interchanging u and z. 
In conclusion we note that the inequality 
[sin 0| =< 18| (12) 


(see § 4.2, Example 5) can be proved on the basis of the material of this 
section in the following way. We have 


t2 








| sin 0 d ! [sine] 
= l | 2x = 1 S 
i1 - | f 5 = f Idt = sin), || <5 
9 | 0 





and since 


and |sin 0| <1, inequality (12) holds for all 0. Further, the inequality 
0 «tan 0, 0 «0 = x/2 (see $ 4.9) can be obtained by using Lagrange's 
theorem on finite increments: 

tan 0 — 0 = (sec? 0, — 1) = 0, 0 x 0, «0 


E 


w]e 


CHAPTER 11 


Series 


§ 11.1. The Notion of a Series 


An expression 
Uoc Ui Us, ... (1) 


where the numbers u (the terms of the series which are complex in the general 
case) depend on the index k — 0, 1, 2, ... is called a (number) series. At 
present we consider this expression purely formally and do not assign any 
number (sum) to it because the ordinary addition of an infinite number of 
summands does not make sense. Series (1) can be written in the abbreviated 
form as 


5 ukg = Yu. (2) 


k=0 0 
The latter expression is also purely formal; in some cases it proves more 


convenient than (1). 
The number 


$, = uo- uy ... tty (n20,1,...) 


is called the nth partial sum of series (1). 
We say that series (1) is convergent if the limit 


lim S, = 


Hn—9 


exists. In this case we write 


S = tout usd ... = y Uk (3) 


k=0 


and call S the sum of the series; in this very sense we assign to expression (1) 
or (2) the number S. We also say that series (3) converges to S. 

By Cauchy’s criterion (which holds for complex numbers as well), for 
series (1) to be convergent it is necessary and sufficient that, given any € > 0, 
there should be N such that for all natural n > N and any natural p the in- 
equality 


holds. 
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|Ungit ~- up] = [Snyp Sal = € 
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In particular, putting p = 1 we see that if series (1) is convergent its gene- 
ral term u, tends to zero: 
lim u, = 0 (4) 


n- oo 


Condition (4) is necessary for series (1) to be convergent but, as will be seen 
from examples, it is not sufficient. 
Let us consider the series called the remainder series of series (1) 


Ungitungat ... = Y Un+k (5) 


Since conditions of Cauchy’s criterion are stated in exactly the same man- 
ner for both series (1) and (5) they are simultaneously convergent or diver- 
gent. If they are convergent the sum of series (5) is 


lim Y uspe = lim (S5,45—5,) = $—S, 


mm kel 


If the terms of series (1) are real and nonnegative its partial sums form a 
nondecreasing sequence Sı = Sz = $3 = ... and therefore if this sequence 
is bounded, that is 


S,=M (n= 1,2, ...) 


then the series is convergent and its sum satisfies the inequality 


lim S, = S = M 
n—-oo 
If this sequence is unbounded the series is divergent: 
lim S, =< 
n--99 
In this case we write 
5 Uk = 3c 
k=0 i 


and say that series (1) with nonnegative terms is divergent to œ or is prop- 
erly divergent. 


Example. The nth partial sum of the series 
14+z+2z7+ ... (6) 


xm 1 
is S2) = LFZ (for z # 1). If |z| <1 then [2*1 = [zt — 0, that 
is 2"+1 + O(n + œ); if |z| > 1 then [z^*1| — oo, and, finally, if |z| = 1 then 
2"*1 = cos (n+1)0+i sin (n+ 1)0 where 0 is the argument of z, and we see 
that the variable z"*! has no limit as n — œ because its real or imaginary 
part (or both) has no limit as n — œ. For, z = 1 the divergence of series 
(6) is quite obvious. 
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We see that series (6) is convergent and has a sum equal to (1—2)^! in 
the open circle |z| < 1 of the complex plane and is divergent at all the other 
points z. 


8 11.2. Operations on Series 


e © 
If Yun and Y vk are convergent series and œ is a number then the series 
0 Ü 


3; ou and Y (uy vy) are also convergent and we have 
0 0 


au, = a Yu. (1) 
and ° i 
Y (uto = Yu £y vi (2) 
Indeed, f 
you. = dd Yeu = a lim yu. = ay u 
and i i i i 


F Qto) = lim Y (u&w) = lim Y utlimy v = Yu ty v. 
0 BEE SSO n-res'Q 0 0 0 


It should be stressed that, generally speaking, the convergence of series 
on the left-hand side of (2) does not imply the convergence of each of the 
series on the right-hand side, which is readily confirmed by the example 
of the series 


(1- D (1- D« ... (3) 

This series is convergent since all its terms are equal to 0 but the expression 

y 1- x 1 does not make sense because the series entering into it are divergent 
(to infinity). 
If a series 

Uo usd ... (4) 


is convergent and has a sum S its terms can be arbitrarily grouped in brack- 
ets (without rearranging them!), for instance, 


Uo (Uy +t2)+ (Ua d 144-5) - ... 


The new series thus formed whose terms are the sums of the numbers in 
brackets is also convergent and its sum is again the number S, for the partial 
sums of the new series form a subsequence of the sequence of partial sums 
of the original series (4). 


27* 
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On the contrary, if we are given a series whose terms are certain sums 
enclosed in brackets then, generally speaking, it is illegitimate to remove the 
brackets because this may destroy the convergence of the original series and 
may change its sum. For instance, series (3) is convergent but if the brackets 
are removed we obtain the divergent series 1-1+1—.... If the terms in 
the brackets are only nonnegative or nonpositive numbers the removal of 
the brackets in such a series does not of course affect its convergence and 
its sum. 


§ 11.3. Serics with Nonnegative Terms 


In this section we shall deal with series whose terms are nonnegative or 
positive numbers. A series with positive terms is referred to as a positive 
series. 


Theorem (Comparison Tests for Positive Series). Let there be given two 
series 
G) Xu. and (ii) yw. 
0 0 
with nonnegative terms. 

(a) If uy = vy (k = 0, 1, 2, ...), the convergence of series (ii) implies the 
convergence of series (1) and the divergence of series (1) implies the divergence 
of series (ii). 

(b) If 

lim “= 4-0 (1) 


kos Uk 


then series (i) and (ii) are simultaneously convergent or divergent. 
Proof. Let series (ii) be convergent and let S be its sum. Then 


aan <S (n =0,1, ...) 
0 0 


which means that the partial sums of series (1) are bounded and hence it is 
‘Convergent. Its sum S’ obviously satisfies the inequality S’ = S. 

Now suppose that series (i) is divergent; then (see § 11.1) its nth partial 
sum increases indefinitely together with n, whence, by virtue of the inequality 


Suso (0201...) 
0 0 


it follows that the nth partial sum of series (ii) also increases indefinitely, 
that is the latter series is divergent. 

Now we suppose that equality (1) is fulfilled. Then the terms v, are in 
fact positive (v, > 0), and for any positive € < A there is N such that 


A-e < = < A+e (k > N) whence 
k 
vy(A— E) < ux < (A+ uk (2) 
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If series (ii) is convergent the series Y (A+ £u, is also convergent and, by 
virtue of the second inequality (2), the sence * ug is convergent together 
with the former; therefore series (i) is Gonvergent. If series (ii) is divergent 
the series y v.(A— e€) is also divergent and, together with it, so is the series 

y Uk- Hence: series (i) is also divergent in this case. 
N41 


The theorem has been proved. 


Theorem 2 (D’Alembert’s* Test). Let there be a positive series 


Y uk (3) 
0 
(ux > O for all k = 0, 1,2, ...) 


(a) If 
megl (k = 0,1,2, ...) (4) 
E 
series (3) is convergent; if 
T] (k = 0,1,2,...) (5) 
k 
series (3) is divergent. 
(b) If 
lim 4 =q (6) 
k—œ Uk 


then series (3) is convergent for q < 1 and divergent for q > 1**.. 
Proof. We have 


Hj Uo it 
Un = uo — = » 


Wow i s (n= 0, 1, 2, ...) 


a 





and therefore it follows from (4) that 
Un mod", q <1 (n = 0,1, 2, ...) 


o2 
This relation shows that, since series $` uog" is convergent, series (3) is also 
1 


convergent. 


* D'Alembert, Jean le Rond (1717-1783), a French philosopher and mathematician. 

** The following more general tests are proved analogously: series (3) is convergent if 

lim pei 
u, 





< 1 and divergent if lim “#1. > 1. 
k — d 
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From (5) it follows that u, = uo (n = 0, 1, 2, ...) and, since the series 
Uo-- uo--- ... is divergent, series (3) is divergent as well. 

Now, if property (6) holds and q < 1 then for any positive e satisfying 
the condition g+e < 1 we have ux+41/u, <qte < 1 (k= N) where N is 


sufficiently large. By test (4), in this case the series Yu, is convergent and, 
N 


together with it, series (3) is also convergent. 
If property (6) is fulfilled for q > 1 it follows that uk+1/ux > 1 (k =N) 


for a sufficiently large N, and therefore, by Test (5), the series Y` wu is divergent 
N 
and, together with it, so is series (3). 


Theorem (Cauchy’s Test). Let (3) be a series with positive terms. 


(a) Uf 


Yu -q-1  (k20,1...) (7) 
Series (3) is convergent; if 
Vuml (k-01...) (8) 
it is divergent. 
(b) If 
k 
lim Yu, = q (9) 
k= æ 


then series (3) is convergent for q < 1 and divergent for q > 1.* 
Proof. Inequality (7) implies that u, < g* (q = 1; k = 0,1, ...) and, 
since in this case the series )' q* is convergent, so is series (3). If inequality 


0 
(8) is fulfilled then u, = 1 (k = 0, 1, ...), and, since the series 1--12-... 
is divergent, series (3) is also divergent. 
Further, from property (9) with q < 1 it follows that 


© Ya<qte=1 — (km HN) 
for sufficiently large N, whence 
ur < (q+) (k=N) 
Since the series Yt £)* is convergent the last inequality implies that Yu. 
is convergent and hence series (3) is also convergent. If property (9) is 


fulfilled for q > 1 it follows that u, > 1 (k = N) for sufficiently large N, 
whence obviously follows the divergence of series (3). 


UN POKER — b,— 
* The following more general tests are proved similarly: if lim Vu, < 1 series (3) is 
k,— 
convergent and if lim y/u, > 1 it is divergent. 
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Remark 1. The series with general term u, = n^? (x > 0) is convergent 
when « > 1 and divergent when x « 1 (see $ 9.15 (5)*). In both cases we 
have 





T lnt = 
iu od eo 
and also 
lim Yu, = 1 (11) 


This shows that there are both convergent and divergent series for which 
conditions (10) or (11) are fulfilled. 
The series 1 4- 1/24- 1/34- ... is called the harmonic series. It is divergent. 


Remark 2. If for a sequence of positive numbers u, there exists the limit 


lim = =q >0 (12) 


it follows automatically that 


lim Vu, =q (13) 


H— 9 
Therefore, theoretically, the limiting form of D'Alembert's test (i.e. (6)) 
does not provide any new information in comparison with the limiting 
form of Cauchy's test (i.e. (9)) but in practice D'Alembert's test proves 
extremely convenient. 
Let us justify what has been said. Suppose that (12) takes place. Then 
for any positive e <q there is n such that q—e < =+ < q+e (k = 


Us k-1 
= 0,1, ...). It follows that 





d, N, H, 
(q— 5) < MED Rt | OB ze (g4- 9 
ln Unt. . la p—1 


ie. (q— €) < Do < (q-- e)?, whence 
uie P(q — enfe << uses < uif rq gna 
On passing to the limit in the last relation as p — œ we obtain 
q—e « lim Vu, «lim Vu, <q+e 
Since £ > 0 can be made arbitrarily small we obtain 


g = lim Yu, = lim Vu, = lim yu, 


n= co 


* In § 9.15 we only used some properties of series presented in § 11.1. 
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The converse is not true: limit (13) may exist when limit (12) does not 
exist. For example, let 4, = q"t/" where “+” is written for even n and 


c 


—” for odd n. Then we have Vu, = gli"* q (n + œ); on the other 
hand, 


m qi*V"*i* Y^ —— (for odd n) 
Q0 | gi-Yasi-Ys (for even n) 





If q = 1 the ratio u,4 1/4, is unbounded and thus has no finite limit. 
Examples 

n Ze, m Ax 

(i) » KY? (ii) Le 


(iv) Yn(iei): (9 Xe * =O) 
1 1 


(2>0); (i) Y(é^-1) 


Series (1) and (ii) are obviously iMi for x = 0. Series (i) is also 


convergent for any x > O because un =F T +10, k — c. As to series 
(ii), it is convergent for 0 < x < 1 and diverser for x > 1 because for this 
series we have S =x (zz zu) — x, k + æ; for the case x = 1 see Remark 
1. Series (iii) and (iv) are divergent because e!*—] = x k + œ, and 





In (1+3 ! x)^ 4 ,k + œ (here “~” is the sign of asymptotic equality; see 


§ 4.10), and the series 2 “Li is divergent. Series (v) is a for 0 <q < 


< ] and divergent iod > ] because for this series we haver ure: mgr uu, 
>q(k = co). iti is also divergent for q = 1 since in this caseits general term 
is equal to 1. 


Theorem. Le! a series 


Uotuytuet ... (14) 
with nonnegative terms be convergent to a sum S. Then the series 
Ug ti uo usd ... (15) 


obtained from the former by rearranging and renumbering its terms in an 
arbitrary way is also convergent and has the same sum S. 
Proof. Let 
Sp = ugtuyt ... Ru, 
be the nth partial sum of series (15). Its terms uo, uj, ..., u, have some indices 
ko, ki, ..., Kn as terms of the original series (14). Let N be the greatest of 
the indices ko, ku ..., kn and Sy be the Nth partial sum of series (14). 
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We obviously have S, = Sy = S, and, since n is arbitrary, series (15) is 
convergent and has a sum S’ = S. Now, interchanging the roles of series 
(14) and (15), we can repeat the same argument whence S = S’. Conse- 
quently S = S$". 

§ 11.4. Alternating Series 


A series of the form 
d9—414- d3—434- ... (1) 


where the numbers a; are positive (ay > 0) is called an alternating series. 
If the numbers a, form a monotone decreasing Sequence convergent to 
zero (a, = ay,1 and a, + O for k — æ) alternating series (1) is called a 
Leibniz series. 

We shall show that a Leibniz series is convergent and that its sum satisfies 
the inequality S « ao. 

Indeed, its partial sum S2,,4, with an odd index 2n-I- 1 can be written in 
the form 


Son 41 = dg—(d1—d2)— (d3—4d4)— ... — (ton 1— 25)— Gene 
whence it obviously follows that it is bounded above by the number cto: 
San4-1 = Ao 
On the other hand, this sum can be rewritten as 
Song = (Go—a1)+(d2—43)+ ... +(Gen—42n+1) 


whence we see that it is monotone nondecreasing. Therefore there exists 
the limit 
lim Song =S< ao 


noo 


It is also obvious that 


lim Sen = lim (S2n41—- 244.1) =S-0=S 


A-r% H- co 


The theorem has been proved. 


Example. The series 1 — 1/2 -- 1/3— ... is obviously a Leibniz series; it is 
convergent and its sum S does not exceed 1 (as follows from § 5.11 (5), 
its sum SS is in fact equal to In 2). 


§ 11.5. Absolutely Convergent Series 


A series 
Uotiituet... (1) 
with complex terms is said to be absolutely convergent if the series 
[uo] - 1a] dus] ... (2) 


of the moduli of its terms is convergent. 
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An absolutely convergent series is always convergent. Indeed, suppose that 
series (1) is absolutely convergent; then series (2) is convergent and, by 
Cauchy's criterion, given any & > 0, there is N suchthat £ > |u,.il+... 
o b [unsp] for all p and n > N. Then moreover, € > |uayit ... d Una pl, 
and, by Cauchy's criterion, series (1) is convergent. 

It is quite obvious that a convergent series with (real) nonnegative terms 
is absolutely convergent. But there are series (with arbitrary terms) which 
are convergent but not absolutely convergent. This can be demonstrated 
by the example of the series 1 — 1/2 -- 1/3*— . . . (e = 0) which is convergent 
for all x — 0 since it is a Leibniz series but is absolutely convergent only 
fora > 1. 


Theorem. /f a series is absolutely convergent, any rearrangement of its 
terms does not violate its absolute convergence, and the sum of the new series 
remains the same. 

Proof. We shall begin with the special case when the terms ux of the series 
are real numbers. 

Let us put (on condition that 1 are real) 


uu uk for uj 0 "m —u, for um <0 (3) 
0 for u.<0 for uk. 0 
The numbers uj and uj are obviously nonnegative and 
ük = Ug uk (4) 


Together with series (1) we shall consider the two series 
y ut and y ug (5) 
0 0 


(with nonnegative terms). 

As was agreed, we suppose that series (1) is absolutely convergent and 
that its terms ux are real numbers. Then series (5) are also convergent be- 
cause we obviously have uj = |u,| and uz = |u;,|. 

Let the series obtained by rearranging the terms of the original series (1) 
have the form v1-+v2+03+ .... For its terms we can construct the corres- 
ponding numbers vý and vg as was done above for series (1). Then (see the 
explanations below) 


Yw-Yt-u)-Ywu-Yiw-Yw-y«u-yYbwu)-Xw 
0 0 0 0 0 0 0 0 


The first equality in these relations follows from (4), the second follows from 
§ 11.2 (2) if we take into account that series (5) is convergent; the third equ- 
ality is implied by the fact that any rearrangement of the terms of a conver- 
gent series with nonnegative terms does not violate its convergence and does 
not alter its sum, the fourth equality is implied by $ 11.2 (2), and, finally, the 
fifth equality is fulfilled because v, = vt — vg . Thus, for real u, the assertion 
of the theorem has been proved. 
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Now we pass to the general case when uy = æg-+ ifr are complex numbers 
and, as before, v, denote the terms of the rearranged series. Since lo] = {ux| 


and |8,| = [|u| the series Y, ær and y B« (with real terms) are absolutely 
0 


convergent and their terms, as was proved above, can be rearranged arbitra- 
rily; therefore, putting v, = y,-- i94 we obtain 


= Y (eiu) = Sati ô= = 


Es 
o di 


Hd 


=} ty Ôk = Y (vet iby) = Dc 


0 
The proof of the theorem has been completed. 
8 11.6. Conditional and Unconditional Convergence 
of Series with Real Terms 
Let us consider a series 
ugd-U14-uo4- ... (1) 


with real terms. As was done in the foregoing section, let us construct the 
two series 


et1$ 


ut and Sur (2) 
0 


(with nonnegative terms) corresponding to it. 

If series (1) is absolutely convergent- then, as we know, series (2) are also 
convergent. The converse is also obviously true: the convergence of both 
series (2) implies the absolute convergence of series (1) because 


dus] = ug tug 


Thus, for series (1) to be absolutely convergent it is necessary and sufficient 
that series (2) generated by it be convergent. ss s. 

Now let us suppose that series ( 1) is convergent but not absolutely. Then 
at least one of series (2), for definiteness, the first one, is divergent, that is 


y uj = œ (because uj = 0). Let us write down the equality 
0 


n n n 

Yu -Yyuw-Yw 6) 
0 0 0 

The first sum on the right-hand side of (3) increases indefinitely together 
with z while the second one tends to a finite limit since series (1) is conver- 
gent; consequently the left member of (3) increases indefinitely as n — æ. 
Hence, series (2) is divergent. 
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Wealso note that the convergence of series (1) implies that u — O and then, 
obviously, we also have ut — 0 and uz — 0. 

We have shown that if series (1) is convergent but not absolutely both 
series (2) generated by it are divergent but at the same time u} — 0 and 
uz > 0. 

This proposition can be restated as follows: 

(i) For a series to be absolutely convergent it is necessary and sufficient that 
the series composed of its positive terms and negative terms be convergent. 

It may however happen that one of these series is a finite sum or does not 
exist at all. 

(ii) If a convergent series is not absolutely convergent then the series com- 
posed of its positive and of its negative terms are divergent while their general 
terms tend to zero. 

The following terminology is often used. A series is said to be uncondi- 
tionally convergent if it is convergent and if any rearrangement of its terms 
does not violate its convergence; it is said to be conditionally convergent ìf 
it is convergent and if its terms can be rearranged so that the convergence 
violated, i.e. so that the rearranged series is divergent. 

The theorem on the commutativity of an absolutely convergent series 
proved in the foregoing section implies that (a) an absolutely convergent 
series is unconditionally convergent. From proposition (ii) and from the the- 
orem whose proof is given below it follows that (b) a series which converges 
not absolutely is conditionally convergent. 

Combining propositions (a) and (b) we can say that for a series to be uncon- 
ditionally convergent it is necessary and sufficient that it be absolutely con- 
vergent. 

Our discussion shows that we can restate equivalently the definition of 
unconditional convergence in the following way: a convergent series is said 
to be unconditionally convergent if the series obtained from it by an arbitrary 
rearrangement of its terms continues to be convergent and has the same sum as 
the original series. l 
. Now we proceed to the theorem mentioned in connection with proposition 


(b). 


Theorem. Le: » a, and x By be two diver, gent s series with positive terms tend- 


ing to zero as k — œ (a, S Oiid Be + 0as k -- c). 
Then for any number S, finite or infinite (— œ = S = œ), it is possible to 
construct a series of the form 


XodtXiT ... 4-&4,—Bo— de — Bi t xk 4i A 
: Tí, — Prit safe — Bi; takt t T (4) 


whose sum is equal to S. 

In the cases S =+ « and S =— «e series (4) is divergent. This series 
includes all xis and fis and each of these numbers enters into the series 
only once. 
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Proof. For definiteness, let S be a finite positive number. The indices kı < 
< kz < ... and ki < ke < ... can be chosen in this case as the smallest 
natural numbers for which the corresponding inequalities written below 
are fulfilled: 


ky ki 
(i) Aic Yay > S, (i) da = As- By <5, 


Gii) Ag = 424 » aj >S, (iv) Aa = A3s— Y B =S 


kı+i kit] 
At the /th stage (/ — 1,2, ... ) of this construction it is possible to choose the 


numbers k; and k; satisfying the /th inequality because the series Ye 
and » B, are divergent. The fact that the series thus constructed is Santeri 


toS follows from the above inequalities and from the assumption that, — 0 
and Br +Oask+o, 

To prove the theorem for the case S = œ we can, for instance, replace S 
on the right-hand sides of inequalities (i), (ii), . .. by the numbers 2, 1, 4, 3, 6, 
5, ... respectively. 


§ 11.7. Sequences and Series of Functions. 
Uniform Convergence 


Let us consider a sequence of functions { f;,(x)} defined on a set of points 
x = (x),..., Xn) of the n-dimensional space R,. They are allowed to take on 
complex yalues (fex). = a,(x)+iB,(x)). We can also assume that x is a 
(variable) complex point (x = x = €+én) running through a set E in the 
complex plane; then f(x) are functions of the complex variable x. 

Let the (number) sequence {/;(x)} tend to a number f(x) for every fixed 
x € E. Since x can vary within the set E the limit f(x) of this sequence is a 
function defined on the set E. Let 


Qn = sup f(x) — f(x) (1) 
xcE 


denote the supremum of the absolute values of the deviations of fa(x) from 
f(x) taken over the set E. We shall suppose that o, is finite for every n (0, < 
- 00 ) 

A sequence of functions { f,(x)} is said to be uniformly convergent on E to f (x) 
if o, > O as n — e. 

Another equivalent definition of uniform convergence reads: a sequence 
(5 (x)) is uniformly convergent to f(x) on E if for any € > 0 there is N such 
that the inequality 


lf/(x)—f(x) >e forallxcE Q) 
holds for all n — N. 
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If the conditions of the former definition are fulfilled then for any « > 0 
there is N such that o, < £ for all n > N whence 


1/6) — G0] «s es < € (3) 


for all x € E and n > N, that is the conditions of the latter definition hold as 
well. Conversely, if the conditions of the latter definition hold then, given 
any £ > 0, there exists N such that inequality (2) is fulfilled for all n > N. 
Taking the supremum of the left-hand side of (2) over all x € E we obtain 
Qn = € (n > N) whence g, — O, that is the conditions of the former definition 
are fulfilled. 

We can also state a third definition of uniform convergence (in terms of 
Cauchy's criterion): a sequence { f,(x)} is uniformly convergent on E if, given 
any € > 0, there is N such that the inequality 


Sata) < E (4) 


is fulfilled for all n = N and p > 0 and for all x € E. 

If a sequence {/,(x)} is uniformly convergent in the sense of the second 
definition it follows that for any e — 0 there is N such that for n > N and 
any p there holds the inequality 


fap (X) —fu(X)] = | far- SEa <2e forall x € E 


that is the conditions of the third definition are fulfilled. On the other hand, 
if the conditions of the third definition hold then for every fixed x € E the 
ordinary Cauchy's criterion for number sequences holds, and therefore the 
sequence is convergent on E to a function f(x). Now, taking an arbitrary 
é>0, we can find the number N as indicated in the third definition and pass 
to the limit as p - œ in inequality (4) where n > N is fixed; this results in 


If()-f.A(x)| se (EE) 
Gx = SUP | f(x)—fi(x)| m e 


whence 


and, since n > N can be taken arbitrarily, we have o, > 0 (n — =), that is 
the conditions of the first definition are fulfilled. > = 

It is easy to see that if œ is a number and (/;(x)) and {¢,(x)} are two segu- 
ences of functions uniformly convergent on E then the sequences {«/;,(x)} 
and (fi(x) x 9i(x)) are also uniformly convergent on E. It can also be readily 
shown that if a sequence of functions is uniformly convergent on E it is also 
uniformly convergent on every subset E' c E. The converse is not true in the 
general case. 

To every sequence of functions (/,(x)) there corresponds the series 


Sox) + (f(x) — fa) + (fF) (x) ... 


whose nth partial sums are equal to f(x) (n = 0, 1, ...) respectively. 
Now let us consider a series 


uc(x)d-11(x)4- u(x) 4- ... (5) 
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whose terms are functions of x € E (generally speaking, assuming complex 
values) where, as before, E is a point set in the n-dimensional space R, or in 
the complex plane. 

Series (5) is said to be uniformly convergent on the set E to a function S(x) 
if the sequence of partial sums {S,(x)} is uniformly convergent to S(x) on E. 

In particular, the definition of a uniformly convergent series can be stated 
as follows: series (5) is uniformly convergent on the set E if for any € > 0 
there is N such that for n => N and p > O and for any x € E there holds the 
inequality |u,s41(x)4- ... usa l < e. 

The theorem below provides an important test for uniform convergence of 
a series. 


Theorem 1 (Weierstrass). Zf the terms of series (5) satisfy the inequalities 
Ju(x)[sa, (kK =0,1,...) (6) 


where x € E and «, are numbers (independent of x) such that the series with 
the terms o. is convergent, then series (5) is uniformly and absolutely conver- 
gent on E." 

Indeed, if the series with the terms c, is convergent, inequalities (6) imply 
that for any £ > O there is N such that for any n > N and p > O and for 
arbitrary x € E the inequality 


E> On41d- arie +n sp = (tapat stes + |Un+p(x)j = 
=æ [Ung i(x)+ ... + su ux) 


is fulfilled. This means that series (5) is uniformly convergent on E. Its abso- 
lute convergence is evident. 
The lemma below will be of use for our further aims. 


Lemma 1. If a function F(x) defined ona set E in the n-dimensional space R, 
is such that for any £ > O there exist 6 > O and a representation of the form 
F(x) = Fi(x)+ Pix) (7) 
such that F, is a continuous function (relative to E) at a point x? € E and 
| Fi(x)] < & for all x.€ E satisfying. the inequality |x —x?| <6 then F is 
continuous (relative to E) at the point x?. 
Proof. We have 


IF(x) — F(x?)] = | Fi(x)—Fi(x)| + | Po) — Fo(x9)] <= 
<= | Fi(x)|+ | Fila) +] Fo(x)— Fo(x?) | < et+et+e = 3e 


provided that |x—x?| < 01, x € E where ô, is sufficiently small. For any 


Ld Ld 
* The number series X æ, is called a dominant series of the functional series X itx), 
kad E-0 


e 
and the series X u,(x) is spoken of as a dominated series. — Tr. 
kag 
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given € > 0 we can first find some ô > O and a representation of form (7) 

mentioned in the conditions of the lemma and, taking into account the 

continuity of F» at the point x°, we can choose 6; < ô so that |F»(x)— 

— F2(x°)| < e for |x—x?| < 01 and x € E, which proves the lemma. 
Now we proceed to another important theorem. 


Theorem 2. If a sequence of functions ( fa} is uniformly convergent on a set 
E to a function f, and f, are continuous (relative to E) at a point x? then the 
function f is also continuous at x°. 

This theorem can be restated in terms of series: the sum of a uniformly 
convergent series of functions continuous at a point x? € E is a continuous 
function at that point. 

Proof. Taking an arbitrary £ > 0 we can represent f(x) as the sum 

f(x) = Snl) tpl) 
and choose N such that jy (x)| = £ on E. This is possible since the sequence 
of functions f, is uniformly convergent to f on E. By the hypothesis, the 
function fy is continuous at x^. Therefore, by Lemma 1, the function f is 
also continuous at the point x?. 

We shall also prove more subtle tests for uniform convergence based on 
the so-called Abel identity (which is an analogue of the formula for integra- 
tion by parts). 

Let us consider a series of the form 


aoflo4-x1f1--&oBa-d- ... (8) 
where a, and fj, are functions of x € E (or constant numbers). 
On putting By = ButitBate+ ... + Box (here n is fixed temporarily) we 
write for the sum «4418441 + ... xu pf 4p Abel’s identity 
EoiPn eid... apap = %n4I181+Gn42(Bo—Bi)+ ... 
+++ Rae p(Bg— Bp-1) = (841—942) Bit 


+ (Gn42-On43) Bot ... (Gne p-1—9245) Bg- 1-4 pBp = 
p-1 


= Y (&4 rk — Xa ka 1) By +én4pBp (9) 
k=1 


whose validity can be easily checked. 

Now we can establish the following two tests for uniform convergence of 
a series of the indicated form (in the case of constant «, and f, we obtain 
a new test for convergence of a number series). 


Theorem 3 (Dirichlet's Test for Uniform Convergence of a Series). If the 
partial sums of the series 


Bot Bit fat ... (10) 


are uniformly bounded and the sequence of the real functions «;(x) is uniformly 
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(relative to x ) convergent to zero (as k increases) on the set E and is decreasing 
for every fixed x then series (8) is uniformly convergent on E. 

Indeed, let M be a constant such that |o,| < M where c, are the partial 
sums of series (10). Then for any n and k we have 


1Bi| = [Orsk On| = [Ong el + 104] 2M 


Therefore, by (9), by virtue of the fact that x, is decreasing and uniformly 
tends to zero, we conclude that the inequality 


ip i pri 
EDI =2M Y (Anik Aniki) X42 p2M = 2Män+1 < E 
ST | kal 


is fulfilled for any 7 > N and p > 0 and any x € E provided that N is suffi- 
ciently large. Consequently, series (8) is uniformly convergent. The last in- 
equality in the above relations holds for all x € E because ~,,41(x) tends to 
zero uniformly as n + e». 


Theorem 4 (Abel’s Test for Uniform Convergence of a Series). If the real 
functions xy form a monotone decreasing sequence (as k increases) for every 
fixed x € E and are uniformly bounded on E, and if series (10) is uniformly con- 
vergent on E then series (8) is also uniformly convergent. 

Indeed, Let M = |z,| (k — 0, 1, ... ; the functions x, can be positive or 
negative!). By the uniform convergence of series (10), for any e > O there is 
N such that | 8,| < e for any n > Nand k. Therefore, by virtue of (9) and by 
the monotonicity of æg, for any n => N and p there holds 
p l —1 
Yank Buk! SE b (ak Ansk) t €lzaspl = 
1 k=1 


. = 8(&o41—2 n p)- £| 55] = 36M 
which means that series (8) is uniformly convergent. | 
Example 1. The series 
LHO- DE-A- nn — (Qm xxl) (11) 
is convergent on the closed interval (0, 1] but not uniformly. Indeed, its nth 
partial sum is S,(x) — x" and 


: (1 for x= I 
lim S,(x) = S(x) = 
xe (9 @) to for Osx =<] 


Therefore o, = sip R= Si(x)| = UP Ix"! = 1, and hence o, does 
x € [0, € (0, 1) 
not tend to zero as fe — co, 


On the other hand, series (11) is uniformly convergent on any closed in- 
terval (0, q] where O < q = 1 because in this case 
on = sup |SQ)-S409| = sup [x"]=q"+0 (n e) 
x € [9, q] x € [9, a) 
20006—28 
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The sum of series (11) is a discontinuous function at the point x = ] al- 
though the terms of the series are continuous on [0, 1]. This indicates that 
the sum of a series of continuous functions which is convergent not uni- 
formly is not necessarily a continuous function. In the example below there 
also exist series (and sequences) of continuous functions which are conver- 
gent to continuous functions although their convergence is not uniform. 


Example 2. Let 
aCe 0 forx=0 and fori/nex-«i (12) 
n forx = 1/2n 


and let f,(x) be extended to the whole interval [0, 1] so that it is linear and 
continuous on each of the subinter- 
vals [0, 1/25] and [1/2n, 1/n] (see Fig. 
11.1). Obviously, the function f(x) thus 
defined is continuous throughout the 
closed interval [0, 1]. It is evident that 
lim f(x) = 0(0 x«l) 


On the other hand, the convergence 
of the sequence /,(x) is not uniform on 
the closed interval [O, 1] since o, = 
= sup |/,(x)—0| = n — e. But on 

x € [0,1] 
any closed interval of the form [e, 1] 
Fig. 11.1 (0 < £ < 1) the convergence is uniform 
because f(x) = Oon [e, 1] for n > 1/e. 





Example 3. The series 


yee and YEE (>) (13) 
i 1 

are uniformly and absolutely convergent for « > 1 throughout the real axis 
— æ <x <æ, Indeed, the absolute values of their kth terms do not exceed 
k-*, and the series Y^ k~* is convergent for « => 1, and hence, by Weierstrass’ 
test, the given series are uniformly convergent (forc > 1). Weierstrass’ 
testis no longer applicable when « < 1 since in this case the series }, k~* is di- 
vergent. But if we take a narrower interval [e, 2z7— e€] where e is an arbitrary 
number such that 0 < e < 27— e, both series turn out to be uniformly con- 
vergent on [e, 2zz— e] for 0 < « « 1. For the partial sums of the series 


4 +cos x+cos 2x--cos 3x+ ... andsinx+sin 2x+ .. 
are respectively equal to 
sin (a+) x cos + -cos (n+) x 
Dlx) = einer Wi K) = — Tun ee 
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(see the example at the end of § 8.2). They are uniformly bounded on [s 
2z-— e]: : 


|D,(x)| = and — |K,(x)| = ——— 


1 1 
2 sin (€/2) sin (e/2) (n= 1,2, .. ) 


Besides, n~*= (+ 1)~* and n^*— 0, and therefore, by Dirichlet’s test, series 
(13) are uniformly convergent on [e, 2z— e]. 


§ 11.8. Integration and Differentiation 
of Uniformly Convergent Series on a Closed Interval] 


Theorem 1. Let there be given a sequence { fu} of (real or complex) continuous 
functions on an interval (a, b] convergent to a function f. If the convergence is 
uniform then 


lim f fAt) dt = f f(t) dt (1) 


x x 


and the sequence j f Silt) dt also converges to its limit function f ft) dt uni- 


formly on [a, b]. In particular, for x = b we have 


b b 
lim I fat) dt = i f(t) dt (2) 


Proof. From the conditions of the theorem it follows (see$ 11.7, Theorem 
2) that the function f is continuous on fa, b] and 


iar IAAD- 9 r0 (n=) 


Thercfore 


à 


J 


> 
' 
mi 





x . x b . 
ft) dt— | S(O a| < f LAG) —/ (0)1 dt = f r, dt = (b—a)r, 
a l a a 


where the right-hand side is independent of x and tends to zero as n + e 
which proves the theorem. 


Theorem 2. A series 
S(x) = uc(x)d- ui(x)-us(x)4- ... (3) 


of ( real or complex) continuous functions uniformly convergent on a closed 
interval [a, b] can be integrated termwise: 
x ux x 
| (0 dr = I uo(t) dt-- f u(t)dt+... — (aexo-b) (4) 
Xo Xo Xo 


28* 
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The integrated series (4) is uniformly convergent on (a, ^]. 
In particular, 
b b b 
S(t) dt = f uo(t) dt + f u(t) dt+... (5) 
a 





Proof. According to the hypothesis, the nth partial sum 
S,(x) = uo(x)+ ... ux) 


of series (3) is a continuous function on (a, b], and the integral of this 
function 


x 


so dt = f uo(t) dt+ ... + fut dt 


Xo 


is the nth partial sum of series (4). Since, by the hypothesis, series (3) is 
uniformly convergent on the closed interval [a, b], the sequence of its partial 
sums (S,(x)) converges uniformly on [a, b] and, moreover, on [xo, x] to 
a continuous function S(x) which is the sum of series (3). Consequently, by 
virtue of Theorem 1, we have the equality 


lim js dt = Í S(t) dt 


xo 


where the convergence is uniform on [a, b]. This equality shows that its 
right member is the sum of series (4) which is convergent to it uniformly on 
[a, b]. i 


Theorem 3. Let 
l uo(x)+tt(x)+ u(x) +... (6) 


be a series of (real or complex) continuously differentiable functions defined 
on a closed interval [a, b]. 
If series (6) is convergent at a point xo € [a, b] and the series 


uu) euo... (7) 


obtained from (6) by the formal term-by-term differentiation is uniformly 
convergent on (a, b], then series (6) is uniformly convergent on [a, b], its sum 
S(x) is a differentiable function, and the derivative of S(x) is equal to the 
sum of series (7). 

This theorem can be restated in terms of sequences: 

Theorem 3'. Let a sequence (S.(x)) of continuously differentiable functions on 
a closed interval [a, b] be convergent at a point xo € [a, b] and let the sequence 
of the derivatives (S;(x)) be uniformly convergent on that interval to a function 
g(x). Then S,(x) is convergent throughout the interval [a, b] to a continuous- 
ly differentiable function S(x), the convergence is uniform and S'(x) = 9(x). 
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Theorem 3 follows from Theorem 3’ if we assume that in the latter the 
function S,(x) (n = 1, 2, ...) is the nth partial sum of series (6); then it 
follows automatically that S,(x) is the nth partial sum of series (7). 

Proof of Theorem 3'. By the hypothesis, the function S,(x) is continuously 
differentiable for any natural n. Therefore, by the Newton-Leibniz theorem, 


Sax) = S, (xo)4- f Si(t) dt, x € [a,b], n2 12, ... (10) 
Xo 
By the conditions of the theorem, the limit 
lim S,(xo) = A 


of the number sequence S,(xo) exists. This sequence can be regarded as 
a uniformly convergent sequence of constant functions. The function g (x) 
is continuous on the closed interval [a, b] because it is the limit of the se- 
quence of continuous functions (S;(x)) uniformly convergent on that interval. 
We also have the equality 


reas 


X 


x x 
lim I Sr) dt = I p(t) dt 
where the convergence is uniform on [a, b] (see Theorem 1). 
What has been said shows that the right-hand side of (10) and, together 
with it, the left-hand side are uniformly convergent, as n — œ, on [a, b] to 
the function 


A+ f p(t) dt 
which we shall denote by S(x). : 

The function p being continuous, the equality obtained can be differen- 
tiated with respect to x. This results in the equality p(x) — S'(x) which holds 
for any x € [a, b]. 

The theorem has been proved. 

Remark. 'Theorem 3' is widely applied in mathematical analysis. It ob- 
viously continues to hold when the index n on which S,(x) depends runs 


through any number sequence n, tending to a (finite or infinite) number no or 
when n tends to no continuously. 


Example 1. Let us consider the series 


æ COS kx +S 
A(x) = Y eo eee) (k=3,2,...) (11) 


k=1 
For even « it has the form 





(a) ry TE 
1 
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and for odd x the form 


() agin 
L 


Since s. cos (exe T) = —k cos (ex 2) we can write, formally, 





A Ad) =— A, ax) (12) 


But this equality does in fact hold for any real x when æ = 3,4, ...; it also 
holds for x = 2 when x is any real number satisfying the conditions 


xz2km  (k=0, +1, £2,...) (13) 


This follows from Theorem 3 and from Example 3 in $ 11.7 where some 
properties of series (a) and (b) were discussed. To prove equality (12) for 
a = 2 and for a fixed x satisfying inequalities (13) we take a closed interval 
[a, b] containing x strictly inside and not containing the points of the form 
2ka (k = 0, +1, ...). Both series (11) are uniformly convergent on (a, b] 
for « = 1 and x = 2, which makes it possible to apply Theorem 3. 


Example 2. Let us take the sequence of the functions 

0 forx-—Oandfor l/n-x«1 
f) = 
&, for x = 1/2n 
which are extended, for every n, to the whole interval [0, 1] so that they are 
linear and continuous on each of the intervals [0, 1/27] and [1/2n, 1/n], 
the numbers æ, forming an arbitrary sequence. Then we obviously have 
lim f(x) = 0 for all x € (0, 1], and 


ama 
1/2n l/n 


f f(x) dx = f 2na,x dx — f 2nat,(x— =) i= Ss 
ò 0 TH 


(14) 





Further, it is evident that 
fy = sup | fn(x)—0| =n 
Osx=l 


The sequence { f,(x)} is uniformly convergent on [0, 1] if and only if «, — 0. 
The relation 


1 1 
[idf fod (Ff) = 0) (15) 


is fulfilled if and only if $+ + 0 (n +=). 


We see that the uniform convergence of f, to f = 0 on [0, 1] implies the 
convergence of integrals (15), which agrees with Theorem 2. But the sequence 
{/,} can also be convergent nonuniformly and in this case property (15) 
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may continue to hold, for instance, when «, = 1. But if we put &, = nthen 
not only the sequence (/,) converges to zero nonuniformly but property (15) 
fails to hold either. 


Example 3. The equality (1—z)^! = I+z+z2+ ... (z= ge, o < 1) 
implies that 


140609 _ ] RT 
30-969) = tee Toe"... 
On separating the real and imaginary parts we obtain 
] 1—-o* m 
P0) = iinan" zte cos 6+? cos 20+... . (16) 


and 
e sin 0 


Q.(0) = {—20 cos do =0 sin 0+ e sin 204- ... (17) 


The function P,(0) is known as the Poisson* kernel and Q,(8) is its 
conjugate kernel. : 


Exercise. Show that P,(0) and Q,(0) (as functions of p and 0) are harmo- 
nic functions (for o < 1), that is they satisfy the Laplace equation 4u = 0 
(see § 7.26 (15) and (17)). Hint: show that o" cos nO and ọ" sin nO are 
harmonic functions for any n and ọ = 0 and then apply the theorem on 
term-by-term differentiation of uniformly convergent series. 


8 11.9. Multiple Series. Multiplication 
of Absolutely Convergent Series 


An expression 


Y Xa (i) 


k=0 I=0 
where ap are (real or complex) numbers dependent on the pair of indices 
k,l = 0, 1, 2, ... is called a double series. The numbers a;, are its terms and 
the numbers 
ott Mb n : ; 
Su = Y J au (m,n=0,1,2...) (2) 


k=0 l=0 


are the partial sums of the series. 
By definition, series (1) is said to be convergent to a number S called the 
sum of series (1) if the limit 
lim Sma = S (3) 


m, n= oo 
exists, that is if, given any € > 0, there is N such that 
(S— Smr = € 


* S. D. Poisson (1781-1840), a French mathematician. 
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for all m, n > N. Then we write 


S= F Va 
k=0 [=0 
Now let us dwell on the special case when the terms of series (1) are 
nonnegative (a,x; = 0). Let us put 


A = sup Snin (4) 


m,n 
If A < æ is a finite number then for any & > O there is a pair of numbers 
Mo, no such that A—e < Smu = A, and, since axı are nonnegative, we have 
S mon, - Smm m, n > N = max (mo, Ho) 
Therefore A—¢ < S mn < A-4- e (m, n > N) and the limit. lim Sm =S= 4 


. m, a 
exists. 


If 1 = æ then (on condition thata,;=0!) we obviously have lim Smu = 
m, Noe x 


= S =o. In this case we write 
È Ya 
k=0 [=0 
Series (1) (with arbitrary terms) is said to be absolutely convergent if the 


series 5" y |ayi| is convergent. As in the case of ordinary series, it can be 
k=0 l=0 
proved (using Cauchy’s criterion) that an absolutely convergent series is 
convergent. 
Together with series (1) we can consider the expression 


» Y au) 
k=0 Mx 
to which a certain number (sum) A can be attributed in the following natural 
way: if the series in brackets is convergent for every k = 0, 1, ... and has 
a sum A,, and the series Y. Ak converges to a number A we put 
0 
A= Y M= Y (Y ou) (5) 
ka0 k=0 \i=0 
Theorem 1. Zf series (1) is absolutely convergent then 
Y» Y an= » (X aw) (6) 
k=0 I=0 k=0 \I=0 


Proof. Let us first suppose that the numbers a,; are nonnegative. Let the 
left-hand side of (6) (which makes sense!) be denoted as S. 


SERIES 44) 


For any nonnegative s and 7 such that s = m we have 


a 


m n 


d Y Yau-S (7) 
0 


I k=0 l=0 


whence follows that the series Y asi(5 —0,1,2. ...) are convergent; con- 


1-0 
sequently, if we fix m in the second inequality and pass to the limit as n — œ, 
the resultant inequality 


» (X au «S 
k=0 M=0 
holds for any m, which implies the existence of the number A (see (5)) and 
the fact that A = S. 

On the other hand, if the number 4 is finite then, for any m and n, we 
have 


Sina = Y X gom Y (X au) <A 


k=) {[=0 k=0 
and therefore 
S = sup S uu =< A 


mn 


We have proved equality (6) for axı = 0. 
Now let a, be arbitrary real numbers. Let us put 


a fari for ap>0 —dy for ag=0 


ağ and ag = | 


for dg <0 0 for a0 
Gy = d&ijp-ag and aft+ag = aul 
ki kt — Aki ki takt kl 


Consequently, the convergence of the series Y »' | a,;| implies that the series 
Y:Y aj; and Y Y az with nonnegative terms are also convergent, and there- 
fore 


Tyee XXa YY aa = 2; (2 aii) - Y (2,9) = (Eo) 
KI ENT kV 
Finally, if ux: = «,44-ify; are complex numbers and the series ^» |ayi| 


is convergent, the series ?' Y^ [œx] and Y. } |x| where œx and By: are real 
numbers are also convergent, and consequently 


EPe-iresrim-pQej mg = Bm 


The proof of the theorem has been completed. 
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Let us proceed to the following question. Let there be given an absolutely 
convergent series of form (1). Its sum S and also the sum $' of the absolute 
values of its terms can be represented as the limits of the sequences 


S = lim Y y au — lim $,, and 
n> oo 0 0 N+ oo 
S' = lim Y Y lau] = lim Sin 


n= 9 0 


respectively, whose terms depend only on one index n. To the sequences 
{Sin} and {S;,} there correspond the series 


S = do0+ (410+ 411 +401) + 
-F(d2o-- do1+ de2+ 212+ 002) - (A304 ...)- ... (8) 
and 
[00] - (1410] - | 11] - | 011) t [220] - 1221] + 42] 4-112] iaol ... (9) 


with terms equal to the sums of numbers in brackets. In the brackets of the 
second series there are nonnegative numbers and therefore its convergence 
is not altered if the brackets are removed: 


[doo -- | 3101 - | 201] - | 820] t-. ... (10) 
It follows that the series 
Qoo 410+ d014- G29 -. ... (11) 


obtained from (8) by removing all the brackets is absolutely convergent and 
hence it obviously converges to S. 

We have shown that if a double series of type (1) is absolutely convergent 
to a number S then the ordinary (one-fold) series (11) obtained from it is 
also absolutely convergent to S. Now, since the terms of an absolutely 
convergent series can be rearranged in an arbitrary way without altering 
its sum, we arrive at the following theorem. 


Theorem 2. /f the terms of a double series of type (1) which is absolutely 
convergent to a number. S. are renumbered in an arbitrary manner as vo, 
91, V5, ... with the aid of one index the series 9o4-01-- 02+ .:. thus obtained 
is (absolutely) convergent to the same number S. 

In conclusion we shall prove the following theorem. 


Theorem 3. Let y uy, and y vi be two absolutely convergent (one-fold) 


0 0 
series and let all the possible products u,v; (k, | = 0, 1,2, ...) be numbered 
with the aid of one index as ws, W2, wa, ... Then there holds the equality 


Y uX’ vi =} wk 
0 0 0 


where the series on the right-hand side is absolutely convergent. 
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5 


Proof. Indeed, let y lui = M and 3 je! = N. The double series 


Y y ut, is absolutely convergent bécinse we have 


k=0 120 
VY S Jol = MN 


22 [ugt] = S |ui X 
v 0 


for any m and n. Therefore 
n 
uy X lim Y= lim Y Y ut = 


eoo e n 
Dex Yo = lim Y 
n— o k=0 l=0 


k=0 I-0 mows pug n= fond 
m 2m Urt = > Wi 


where the last equality is et ij virtue of the foregoing theorem 


*is absolutely convergent for any complex 


> 


i it4 a 


Example. The series y(7) = Y 


z. Consequently, by Theorem 2, we have 
u w u w, 
Gna Ea ett Ht 


v2) yp) = 14 T4 T A I 


for any complex z and u where the series on the right-hand side is absolutely 





convergent. 
Taking into account that 
Pa mant oa uP (z+) 
tami t apt 
we see that 
hay 
= (z+ u) 





(2) ou) =F 
0 


When two absolutely convergent series Y u, and Zware multiplied by 
each other their product is often represented in the form of the one-fold 


series 
eo id 
3 uy XY, Ui = UoVo- U1Vo+ Uo91 + UV HUIVI + Ho02 - UsVo- 


0 
(especially in the theory of power series; see $ 11.11). This very operation has 


been performed in the above example. 
In conclusion we note that a similar theory can be developed for multiple 


series of form 


y È Akims ++ 


k=0 l=0 m0 
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(this is a triple series) and, generally, 


e 
Cy Akis +o ky 


ieee k,=0 
For such series it is possible to prove, by analogy, the theorems similar to 
Theorems 1-3. 
§ 11.10. Method of Arithmetic Means for Summation 
of Series and Sequences 


Let us consider a number series 





uoa... (1) 
and denote 
S, = uod ua Fund... T ln (2) 
and 
g, = Difin +S, (n= 0. 1, 2, ...) (3) 
If there exists the limit 
lim 0,26 (4) 


n— co 


the method of arithmetic means attributes the "sum" o to series (1) (or the 
“limit” ø to the sequence (5,)). 


Theorem. /f series (1) converges to a number S then its summation by the 
method of arithmetic means leads to the same number S. 
Proof. Let series (1) be convergent, then there is M > O such that 
|S;| = M (j=0, 1, ...) (5) 
and there is also a sufficiently large natural n (which will be regarded 


as fixed while the indices k and p below will be understood as variable) such 
that 


IS e- S| <E (A = 1, 2, ...) (6) 

Further, we have 
S-an = (8-4 $ Sa) [i-us S 
n+p — p & 22) “Vp ep pep) L Bask ulp-l x k 

kool k-1 
NA ! B : 
whence, taking into account that — —- A = ae ee , we obtain 
= Pp nopcl pin-p-li 
1 n-- | 

|S—ongp| = e+ aT M pf e gy M < etete = Se (p > po) 


if p is sufficiently large. Consequently o,,., — S (p — œ) or, which is the 
same, 2, + S(j — œ), which completes the proof of the theorem. 
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Example. The series 1—1+41—... is divergent while the summation by 
the method of arithmetic means gives the value o = 1/2. 


8 11.11. Power Series 
A series of the form 
Got aiz +a? + .,, (1) 


where a, (k = 0, 1,2, ...) are constant numbers (which may be complex in 
the general case) and z is a complex variable is called a power series, the 
numbers a, being referred to as its coefficients. 


Theorem (Abel). Zf series (1) is convergent at a point zo = O of the complex 
plane then it isconvergent absolutely and uniformly in the circle 


Iz) «4 (2) 
where q is any (fixed) number satisfying the inequalities 
0 <q =< Izol (3) 


Proof. The convergence of series (1) at the point zo implies the existence 
of a constant M > O such that 


Ja,zk| = M (k 20,1, ...) (4) 
Consequently, for the points z satisfying inequality (2) we have 


“Mek  (k20L..) a=; <1 


|a,z*| = |a,z6| iz 
iu 








2 
Zo 
Thus, thé moduli of the terms of series (1) do not exceed the corresponding 
terms of the convergent dominant series 


M+Ma+Ma? (Ma">0;n=0,1,2, ...) 


for all z belonging to circle (2). Hence, by Weierstrass’ test, series (1) is 
absolutely and uniformly convergent for all such z’s. The theorem has been 
proved. 

Note that, according to Weierstrass’ test, series (1) is convergent for every 
z belonging to the open circle |z| <|zo| since q in Abel’s theorem is an 
arbitrary number satisfying the inequality q < |zo|. At the same time, as is 
seen from examples, the convergence of the series in that open circle is by 
far not always uniform. 

Let 


R= sup |z| (5) 
zem 
be the supremum taken over the set W of points z for which series (1) is 


convergent. In the general case 0 = R =œ. The (finite) number R is called 
the radius of convergence of power series (1). 
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(i) IO < R =œ then, for any z such that |z! < R, series (1) is convergent 
because, according to the definition of supremum, there is zı € M such that 
iz] <|zil < R and series (1) is convergent for z = zi. Therefore, by Abel’s 
theorem, it is also convergent for z. 

(ii) On the other hand, in the case of finite R, series (1) is sure to be diver- 
gent for any z such that |z| > R; this is a direct consequence of the definition 
of the number R. 

There can obviously exist only one number R possessing properties (i), 
(ii). What has been said allows us to assert that the radius of convergence of 
a power series convergent for at least one value z # 0 can be defined as 
the number R > 0 (finite or infinite) for which properties (i) and (ii) hold. 
If a given power series is only convergent at one point z = O then, by the 
definition stated above, its radius of convergence is equal to zero (R = 0). 

If R > 0, the (open) circle |z] < R in the complex plane is called the 
circle of convergence of power Series (1). 

Finally, we can also give a third definition of R by putting it equal to the 
reciprocal of the number 


that is 
R=1/A (6) 
on condition that 1/c» = 0 and 1/0 = æ. 

Indeed, let us begin with the case R => O (it can be, in particular, that 
R =~) where R is understood in the sense of the first or second definition. 
If Ri is an arbitrary number satisfying the inequalities 0 < Ri < R, series 
(1) converges at the point z = Rj, and the absolute value of its general term 


k,—— 
is bounded: |a, RE| = M (k = 1, 2, ...). Therefore Ria « y M, whence 
Ri lim Vla] = lim Ria; = lim VM = 1 
k— w 


that is 
A «Ri 7) 
By the arbitrariness of Ri < R, relation (7) implies the ‘inequality 
Asi/R (8) 


which obviously continues to hold for R = 0. 
Now, if R is finite, series (1) is divergent for z = R1 > R and, more- 
over, the series ` |a,| Rf is also divergent, this shows that there must be 


lim Via Ri RE = 1 (if otherwise, the series would satisfy the conditions of 
Cauchy’s first test, see footnote on p. 421). Consequently, Rid = Ri lim x 


xia = ] for any R; > R, whence RA = 1, that is 
A 2 1/R (9) 


Obviously inequality (9) continues to hold for R = =~. 
Fipally, (8) and (9) imply (6). 
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Examples 
1+z+2+... (10) 
142454... @>0 (11) 
1424212243134 ... (12) 
Z z? z? 
lt+ +a tart e (13) 


On the basis of formula (6) we conclude that the radii of convergence of 
series (10) and (11) are equal to 1, for series (12) the radius of convergence is 
equal to 0 and for series (13) to œ. 

The sum of series (10) (called the geometric series) is equal to (1—2) ^1 
in the open circle |z| < 1; its remainder is 


m2) == +0 (n+) 





-z 


But the convergence of the series in the indicated open circle is not uniform. 
For instance, this can be demonstrated by the fact that even for positive 
z = x satisfying the condition 0 < x < 1 there is no number N such that 
inequality e > x"*!/(1—x) is satisfied for all n > N and all x € (0, 1]. 
For æ > 1 series (11) is uniformly convergent throughout the closure of 
its circle of convergence since |z*|/k* = k^* and Ý k^* < e (|z| = 1). 
Series (12) is convergent at only one point z = 0 while series (13) is con- 
vergent throughout the complex plane. 


§ 11.12. Differentiation and Integration 
of Power Series 


We shall prove that if a power series 
f (2) = Gotaiz+aez"+ ... (1) 


having a radius of convergence R -0 (in particular, there can be R = œ) 
is formally differentiated term-by-term, the resultant (differentiated) series 


p(z) = a14-2aez4-3asZ?- ...- dose nets) 
has the same radius of convergence R, and 
f'(2-99Gz.  Iz|-«R (3) 


Indeed, let R' be the radius of convergence of series (2). It is evident that 
the series 
aız+2a2z?+ 3a3z?+ ... (4) 


obtained from series (2) by multiplying its terms by z has the same radius of 
convergence R’. If |z| < R’, then series (4) is absolutely convergent, and, by 
virtue of the inequality |a,z"|<|a,z"|, series (1) is also absolutely conver- 
gent. This means that R’ = R. On the other hand, if z is an arbitrary comp- 
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lex number such that |z| < R then there is another number zı such that 
|z| = |zı| = R, and therefore there is a number M > 0 for which |a,z%| = M. 
Then we have 


nfa,z"| = n{ = jazi «Mz (n — 0,1, ...) (5) 
1 1 


and, since, by Cauchy* s test, the series formed of the right members of (5) 
is convergent, series (2) is also convergent, whence R « R'. 

Hence we have shown that R — R'. 

Now we proceed to prove (3). Let z be an arbitrary complex point belon- 
ging to the circle |z| < R and let Ri bea (finite!) number such that |z| < 
< Ri < R. Below we consider only those complex numbers /: for which 
Ih] = Rı— |z| = ô (ô — 0). Then [z+/| = Ri, and we have 


LEADS L | 4) Los... (6) 


where 
a,(h) = an =a,((z+h) 14 (z+hy z+... +2"74) 


(lhl > 0, n= 1,2, ...) 


(z+h)"—2 
h 


Let us also put 
%,(0) = a, lim eu = na,z"-i (7) 
n--0 


By this convention, the terms of series (6) are defined not only for |A| > 0 
but also for A = 0, they are continuous functions of h in the closed circle 
IA | = 6 and obviously satisfy the inequalities 


le, (5)| = lanl (RE REAR + ... +R) Enla RD? (lAl = ô) 


The positive numbers on the right-hand sides of these inequalities are 
independent of A, and the series formed of them is convergent. Indeed, R 
is not only the radius of convergence of series (1) but of series (2) as well. 
Therefore, by Weierstrass’ theorem, series (6) of functions continuous in 
the closed circle [^| = 6 is uniformly convergent on that circle. It follows 
that the sum of series (6) is also a continuous function of h in that circle, 
and, in particular, at the point h = 0. Consequently, the limit 


lim ferh-f. = 01(0)+a2(0)+ ... 
exists when the complex variable h tends to zero in an arbitrary way. Thus, 
the derivative f‘(z) (understood in the sense of a complex variable) exists for 
any z satisfying the condition |z] < R and is equal to 


f'(z) = a14-2aoz 4-3asz?4- ... 
whence follows (3). 
A thorough investigation of term-by-term integration of power series 
involves the notion of a line integral of a complex function which will not be 
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treated here. Therefore we shall confine ourselves to considering the integ- 
ration problem for power series 


f(X) = aet ayxtaox?+ ... (8) 


in the real variable x (z — x). 

Let us take a series of type (8) convergent in an interval — R < x < R 
where 0 < R «c». The numbers a, can be real or complex. Choosing a 
point xo € (— R, R) which will be regarded as fixed and denoting by x the 
variable point belonging to (— R, R) we can find q > 0 such that — R < 
< q-Xo X <q < R. Power series (8) is uniformly convergent in the 
closed interval [—4, q] lying strictly inside the interval of convergence of 
the series. Therefore it can be integrated termwise (see $ 11.8, Theorem 2) 
over the closed interval with end points xo and x: 


[PO dt = ao(x—x0) t (x°— 39) + 508—394... 


(—R « x, xo < R) (9) 
In particular, putting xo = 0 we obtain 


fro dt = agxt F +E (-R<x<R) (10) 
0 


Examples 


arctan x = x 42 — T" (—1«x-«1) (11) 


3 13 x5 1-3-5 x? 


arcsin x — XT Ret yt: (—1 sx <]) (12) 


These equalities are obtained for x € (—1, 1) by means of term-by-term 
integration of the well-known equalities 


TF = 1—x?- x!— "ous 
and 
1 = x? 1-3 xf 1:3-5 x! 
uoce = 144-57 zt 3 wat (13) 


respectively over the closed interval with end points 0 and x. By Leibniz 
test, series (11) is convergent at the points x = I and x = — I. Equality (11) 
itself holds by virtue of Abel's second theorem proved below. 

Series (13) is not convergent for x= 1 and x= —1 because, if otherwise, 
by A bel's second theorem, its sum would be a continuous function on [— 1, 
+1]. At the same time series (12) is convergent at the points x = 1 and 
x — —] because for these points the absolute value of its general term 
20006—29 
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satisfies (see the explanations bellow) the asymptotic relation 
(2n—1)!! |  Qn—-1)!! (2n)!! (2n)! 


_ _V2a(2nynt iment y 1 (nas 
C rannte- n4 1) x ¥n(2n+1) i 

Here we have written the symbol ~ which was already used in § 9.18. 
In the fourth of the above equalities ( with ~) we have applied Stirling’s 
formula (§ 9.18 (6)). The series whose general term is equal to the rightmost 
member of the last relations is convergent and therefore series ' u, is also 
convergent (see § 11.3 (1)). 

According to Abel’s second theorem, the convergence of series (12) at the 
points x = +1 implies the continuity of its sum S(x) on the interval [— 1, 
+1]. For the open interval (— 1, +1) we have the equality S(x) = arcsin x; 
since the function arcsin x is continuous on [—1, +1] this equality also 
holds for the entire closed interval [—1, +1]. 


Abel’s Second Theorem. 7f a power series 
f(x) = agt- aix asx?- ... (14) 


has a radius of convergence R <œ and is convergent at the point x = R 
then the function f(x) is continuous not only in the open interval (— R, R) 
but also in the half-open interval ( — R, R]. 

Indeed, the general term of series (14) can be written in the form 


a,x" = a,R'(x| RY" 
where the (constant) numbers a,R" can be regarded as the terms of a con- 
vergent number series while the expressions (x/R)" form a sequence of 
functions bounded and nonincreasing on [0, R} (1 = (x/R) = (x/Ry*'; 
n = 0,1, ...). Therefore, by Abel’s test (see§ 11.7, Theorem 4), series (14) 
of functions continuous on the closed interval [0, R] is uniformly convergent 
on that interval and, consequently, its sum f(x) is a continuous function on 
[0, R]. 
§ 11.13. Power Series Expansions for the Functions e7, 
cos z and sin z of Complex Variable z 


The functions e*, cos z and sin z of the complex variable z are defined as 
the sums of the series 


ND z zz, 2? 
exp z=e7 = l+y7+aytat-: (1) 
2 
cos Z = I-A (2) 
and $o nd 
sinz = 2-3 +4;---. (3) 


respectively. 
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These series are convergent for any complex z because the radius of con- 
vergence of each series is equal to œ. Thus, the functions e7, cos z and sin z 
are defined throughout the complex plane. For real z = x these definitions 
lead to the well-known real functions e*, cos x and sin x (see § 5.11). 

The function e7 possesses a remarkable property expressed by the identity 


eztu — ezeu (4) 


holding for any complex z and u (see the example in § 11.9). 
It is evident that for any complex z we have 


e = cos z+i sin z (5) 
cos z = 5 (elt beh) and sinz = a (e= — e7) (6) 
Equalities (6) are known as Euler’s formulas. From (6) and (4) follow the 
formulas 
sin (z+u) = sin z cos u+cos z sinu 
and 
cos (z+) = cos z cos u—sin z sin u 
which hold not only for real but also for any complex z and u and are the 
generalization of the well-known trigonometric formulas. 
Finally, (4) implies that for z = x+iy we have 
e = ee? = e*(cos y+isin y) (7) 


The function z = In w of the complex variable w is defined as the inverse 
function of the function 


w = et (8) 
We can write (for w = 0) in the exponential form w = ge" (p = |w| = 0), 
and equality (8) is then written as 
pe? = ere” (z= x+iy) 
Consequently 
z = in w = hn |w|+i Arg w = ln |w|-Fi arg wti2dka (9) 
(k = 0, +], +2, ...) 
where In | w| (Iw| = 0) is understood in the ordinary sense. It is seen from (9) 
that In w (w = 0), together with Arg w, are many-valued (more precisely 
infinite-valued) functions of w, irrespective of whether w is real or complex. 
For instance, from the point of view of the theory of functions of a complex 
variable the natural logarithm of 1 (In 1) is equal to any of the numbers 


2 kxi(k = 0, +1, +2, ...). In real analysis In 1 is understood as the number 
0 which is one of the above values. 


29* 
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Here we shall not consider further topics of the theory of functions of 
a complex variable and shall only confine ourselves to the following remark 
concerning the formula 


In(lt¢x)=x-T 40-0. (=l exel) (10) 


which was derived in§ 5.11 for real x. If x is replaced in the right-hand side 
of (10) by a complex number z with |z| < 1 the series continues to be conver- 
gent. We can say that its sum is equal to In (1--z) where the logarithm is 
understood in the sense of the above general definition, more precisely, its 
sum is equal to one of the branches of the infinite-valued function In (1 4-2). 

Functions of a complex variable which can be expanded into convergent 
power series (Taylor’s series) are called analytic functions. They are studied 
in a special division of higher mathematics called the theory of analytic 
functions or the theory of functions of a complex variable. 
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for limit of a function 96, 218 
for sequences 76 
for series 417 
for uniform convergence 430 
form of the remainder for Taylor’s 
series 155 
inequality 184 
mean value formula 147 
principal value of a divergent improper 
integral 390 
test for convergence of positive series 
423 


Centre of curvature 206 


Change of variables in derivatives 213, 
326 
Circle of convergence of a power series 
445 
Closed ' id 
interval on the real line 14 
set 243 
Closure 246 
Commutative law 
for addition of numbers 53 
for multiplication of numbers 54 
Complex 
function 327 
numbers 320 
Composite function (function of a function) 
17 
Continuous 
curve 189 
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function 221, 249 
of a complex variable 327 
vector function 186 
Convexity of the graph of a function 167, 
169 
downward 168 
upward 168 
Coordinates 
curvilinear 303 
polar 26 
Countable set 87 
Curvature of a curve 200 
Curve 
Curve 
closed 191 
continuous 189 
Jordan 191 
not intersecting itself 191 
oriented 189 
piecewise continuous 176 
piecewise smooth 191 
plane 205 
Tectifiable 196 
smooth 189 
Cuspidal point of a curve 297 
Cycloid 204 


D’Alembert’s test for 
series 42] 
Darboux’ 
lower and upper integrals 354 
sum 353 
Decimal fraction 46 
Dedekind cut 58 
Derivative(s) 31, 34, 127, 128 
of a composite function 134, 231 
of higher orders 140 
of inverse function 136 
left-hand 34, 128 
partial 225, 254 
right-hand 34, 128 
of a vector function 187, 194 
Derived set 86, 244 
Difference 
of complex numbers 322 
of sequences 72 
of sets 15 
Differential(s) 
of higher orders 140, 230 
Differentiation 
of functions 34, 131, 229 
of series 435, 447 
Dirichlet’s 
function 358 
kernel 325 
test 


convergence of 
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for convergence of an improper 
integral 381 
for convergence of a series 432 
Discontinuity 
of the first kind 107 
removable 107 
of the second kind 109 
Domain of definition of a function 16 


Ellipse 193 
Elliptic integrals in Legendre’s form 350 
Euclidean n-dimensional space 181 
Euclid’s algorithm 330 
Euler’s 

formulas 300 

substitutions 342 
Evaluation of indeterminate forms 171 
Evolute of a curve 200, 202 
Evolvent (involute) 202 
Existence 

of 20 Hen of a system of equations 


n 
of Ya 115 
Extremum 144 


Formula(s) 
Frenet-Serret 207 
Leibniz’ 141 
Maclaurin 159 
Mausnier’s 299 
Newton-Leibniz 43, 367 
Ostrogradsky’s 337 
quadrature 402 
rectangle 402 
Simpson’s 404 
Stirling’s 391 
Taylor’s 151, 257, 390 
trapezoid 402 

- Wallis’ 391 

Function(s) 16, 20 
analytic 165, 166, 452 
complex, of a real variable 327 
of a complex variable 325 
composite 17 
constant 23, 102 
continuous 176 

on a bounded closed set 109, 


at a point 27, 98, 221 
from the left 102 
from. the right 109 
differentiable 132, 227 
discontinuous at a point 99 
elementary 23, 159, 224 
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even 18 
exponential 25, 115, 163, 450 
implicit 22, 266 
infinitely differentiable 165 
inverse 22, 112 
inverse trigonometric 25 
logarithmic 115, 452 
many-valued 20 
monotone 104 
odd 18 
one-valued 16, 112 
Piecewise smooth 176 
power 23, 24, 120 
rational 24 
on a set 249 
of several variables 21 
smooth 176 
trigonometric 25, 35, 103, 
412, 451 

Functional 404 
linear 404 

Fundamental solution of heat conductivity 

equation 240 


159, 160, 


Gradient of a function 231 
Graph of a function 18 


Hamiltonian operator (or nabla or del) 
236 

Harmonic series 9, 423 

Heine-Borel lemma (on finite covering) 
256 

Hodograph of a vector function 188 

Hyperbolic point 301 


Image under a mapping 16 
Imaginary part of a complex number 321 
Implicit function 266 
-Increment `: 
of a function 27, 29 
of an independent variable 27 
Independent variable 16, 141, 240 
Inequality 
Bernoulli's 116 
Bunyakovsky's 183 
Cauchy's 184 
Minkowski's 184 
of numbers 50 
triangle 184 
Infimum 55 
Infinite 
decimal fraction 47 
interval 15 
limit 74 
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Infinitely large magnitude 74 
Infinitesimal 74 
Instantaneous velocity 31 
Integral 
of a continuous function 358 
definite 39 
elliptic 350 
improper 373-390 
indefinite 38, 314 
of a monotone function 358 
with variable limit of integration 365 
Integral test for convergence of series 383 
Integration 41 
by change of variable (by substitution) 
369 
by parts 314, 368, 380 
of series 435, 447 
of trigonometric functions 346 
Interior point of a set 216 
Intersection (or meet) of sets 15 
Interval 14 
Invariance of the form of the first differen- 
tial 142, 241 
Inverse 
function 112 
trigonometric functions 412, 413 
Irrational numbers 45 
Isolated point of a set 249 
Isomorphism 58, 59, 321 


Kernel 
Dirichlet's 325 
Poisson's 439 


Lagrange's 
form of the remainder in Taylor's 
formula 155, 156, 258 
interpolation formula 401 
multipliers, method of 289 
Laplacian operator 308 
Leibniz formula 141: 
L'Hospital's rule 176 
Limit 
of a function 90, 218 
in a given direction 219 
inferior 81 
from the left 104 
from the right 104 
of a sequence of complex numbers 325 
of a sequence of real numbers 68, 69 
superior 81 
of a vector function 186 
Limit point of a set 243 
Linear space 180 
normed 184 
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Local 
extremum 144, 262 
maximum 144, 262 
minimum 144, 262 


Manifold, one-dimensional 193 
Mapping 274 
Maximum 144, 262 
Mean value theorem for integrals 
first 263 
second (Bonnet’s) 370 
Minimum 144, 262 
Mobius strip 286 
Modulus (absolute valuc) of a complex 
number 322 
of continuity 250 
Multiple series 439 
Multiplication 
of complex numbers 320 
of sequences 72 


Nabla (or del or Hamiltonian operator) 236 
n-dimensional 
ball 215 
cube 215, 216 
rectangle 216 
vector (z-tuple of numbers) 180 
Necessary condition 
for convergence of a series 417 
for integrability of a function 352 
Neighbourhood 70, 104, 218 
Nested interval theorem 55, 256 
Newton’s binomial formula 153, 162 
Newton-Leibniz theorem 43, 365 
Norm 184 
Normal to a curve 199, 206 
` principal 206 
Normed space 184 
Number 
complex 320 
irrational 46 
rational 45 
real 45 
Number e 77, 121 
Number z 412 


One-sided 
derivative 34, 128 
limit 104, 105 
neighbourhood 104 
One-valued function 16 
Order of a variable 122 
Orientable surface 281 
Oriented 
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curve 189 
surface 281 
Oscillation of a function 
at a point 252 
on a set 252-253 
Osculating plane 205 
Ostrogradsky’s integration method 337 


Parametric differentiation 189 
Parametrization 
of a curve 189 
of a surface 281 
Physical quantity (magnitude) 58 
Plane 
normal to a curve 206 
osculating 205 
rectifying 210 
tangent 205 
Point 
boundary 247 
cuspidal, of a curve 297 
of discontinuity 99 
of the Grst kind 108 
removable 107 
of the second kind 109 
elliptic 301 
hyperbolic 301 
of inflection 167 
interior, of a set 216 
isolated 249, 294 
of n-dimensional space (n-tuple of 
numbers) 180 
parabolic 301 
stationary 288 
Polar coordinates 26 - 
Polynomial 23, 222, 328 
Taylor's 151 ` 
Power ; 
i function 23, 120 
series 163, 445 
Principal 
linear part of increment of function 
132, 228 
normal of a curve 206 
radii of curvature of a surface 300 
value (Cauchy’s) of divergent improper 
integral 390 


Radius 
of convergence of a power series 445 
of curvature 205, 300 
Rational 
function 24, 222, 332 
number 45 


Real 
number 45 


part of a complex number 321 


Rectifiable curve 196 

Rectifying plane 210 

Remainder in Taylor’s formula 
in Cauchy’s form 155 
in integral form 260, 390 
in Lagrange's form 155, 258 
in Peano's form 158, 261 

Riemann's 
(definite) integral 351 
integral sum 351 

Rolle's theorem 146 

Root (zero) of a polynomial 329 


Scalar product 182 
Screw-line (circular helix) 208 
Semi-infinite interval 15 
Sequence 
bounded 76 
above 50 
below 76 
convergent 69 
of functions 429 
infinitely large 74 
infinitesimal 74 
monotone 76 
nondecreasing 50 
nonincreasing 50 
stabilization of 50 
uniformly convergent 429 
Series 417 
alternating 425 
convergent 417 
divergent 418 
absolutely 425, 440 
' conditionally 428 
unconditionally 428- 
of functions 429 
‘harmonic 423 
Leibniz' 425 
multiple 439, 443 
with nonnegative terms 420 
number 417 
positive 420 
power 164, 445 
Taylor's 163 
uniformly convergent 429 
Set 14 
bounded 56, 245 
above 56 
below 56 
closed 246 
countable 87 
open 215 
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unbounded 56, 245 
uncountable 88 
Singular point of a curve 293 
Space : 
Euclidean, n-dimensional 180 
linear 181 
normed 184 
with scalar product 181 
Stirling's formula 391 
Strictly decreasing sequence 144 
Strictly increasing sequence 144 
Subsequence 80 
Sum 
Darboux's 353 
partial, of a series 417 
Riemann's, integral 41, 351 
of sequences 72 
of a series 163, 417 
(union) of sets 15 
Summation of series 444 
Supremum 55 
Surface 
intersecting itself 282 
orientable 284 
oriented 284 
parametric representation of 281 
smooth 277 


Table 
of derivatives 139 
of integrals 315 
Tangent line 28, 32, 194 
Tangent plane 205 
Taylor's 
formula 151, 257 
polynomial 151 
series 163 
Test 
for convergence of serics 
Abel's 432 
Cauchy's 422 
D'Alembert's 421 
integral 383 
for uniform convergence 
Dirichlet's 432 
Weierstrass’ 431 
Theorem 
Cauchy's, mean value 147, 194 
Chebyshev's 344 
Fermat's 145 
Lagrange's mean value 147 
Lebesgue's 359 
mean value, for integrals 364, 370 
Rolle's 146 
Weierstrass', on uniform convergence 
431 
Torsion (second curvature) of a curve 207 
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Trigonometric form of a complex number Vector function 186 f 
321 Volume of a solid of revolution 396 


Uncountability of the set of real numbers 
88 Walli’s formula 391 


Uniform Weierstrass’ . 
continuity 251 test for uniform convergence of series 
convergence 431 

of a sequence of functions 429 theorem 86 
of a series of functions 429 on boundedness of a continuous func- 

Union (sum) of sets 15 tion on a bounded closed set 109 

on extremal properties of continuous 

Variable 16 functions 110 ub 
dependent 16, 141, 240 on limit point of a bounded infinite 
independent 16 Set 86 
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